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Much  learning  is  done  by  way  of  studying  precedents  and  exercises.  A  teacher 
supplies  a  story,  gives  a  problem,  and  expects  a  student  both  to  solve  a  prob- 
lein  and  to  discover  a  principle.  The  student  must  find  the  correspondence 
between  the  story  and  the  problem,  apply  the  knowledge, in  the  story  to  solve 
the  problem,  generalize  to  form  a  principle,  and  index  the  principle  so  that 
it  can  be  retrieved  when  appropriate.  This  sort  of  learning  pervades  Manage¬ 
ment,  Political  Science,  Economics,  Law,  and  Medicine  as  well  as  the  develop- 
ment  of  common-sense  knowledge  about  life  in  general.  This  paper  presents  a  -  | 
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20.  theory  of  how  it  is  possible  to  learn  by  precedents  and  exercises  and 
describes  an  implemented  system  that  exploits  the  theory.  The  theory  holds 
that  causal  relations  identify  the  regularities  that  can  be  exploited  from  past 
experience,  given  a  satisfactory  representation  for  situations.  The  represent¬ 
ation  used  stresses  actors  and  objects  which  are  taken  from  English-like  input 
and  arranged  into  a  kind  of  semantic  network.  Principles  emerge  in  the  form 
of  production  rules  which  are  expressed  in  the  same  way  situations  are. 
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Abstract 

Much  learning  is  done  by  way  of  studying  precedents  and  exercises.  A  teacher  supplies 
a  story,  gives  a  problem,  and  expects  a  student  both  to  solve  a  problem  and  to  discover 
a  principle.  The  student  must  find  the  correspondence  between  the  story  and  the 
problem,  apply  the  knowledge  in  the  story  to  solve  the  problem,  generalize  to  form  a 
principle,  and  index  the  principle  so  that  it  can  be  retrieved  when  appropriate.  This  sort 
of  learning  pervades  Management,  Political  Science,  Economics,  Law,  and  Medicine  as 
well  as  the  development  of  common-sense  knowledge  about  life  in  general. 

*  This  paper  presents  a  theory  of  how  it  is  possible  to  learn  by  precedents  and 
exercises  and  describes  an  implemented  system  that  exploits  the  theory.  The  theory 
holds  that  causal  relations  identify  the  regularities  that  can  be  exploited  from  past 
experience,  given  a  satisfactory  representation  for  situations.  The  representation  used 
stresses  actors  and  objects  which  are  taken  from  English-like  input  and  arranged  into  a 
kind  of  semantic  network.  Principles  emerge  in  the  form  of  production  rules  which  are 
expressed  in  the  same  way  situations  are. 

This  research  was  done  at  the  Artificial  Intelligence  Laboratory  of  the  Massachusetts 
Institute  of  Technology.  Support  for  the  Laboratory’s  artificial  intelligence  research  is 
provided  in  part  by  the  Advanced  Research  Projects  Agency  of  the  Department  of 
Defense  under  Office  of  Naval  Research  contract  N00014-80-C-0505. 
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PRECEDENTS  AND  EXERCISES 


This  paper  presents  a  theory  of  how  it  is  possible  to  learn  principles  from  precedents 
and  exercises.  The  theory  holds  that  causal  relations  identify  the  regularities  that  can 
be  exploited  from  past  experience  in  Management,  Political  Science,  Economics, 
Medicine,  and  Law  as  well  as  from  everyday  life. 

The  paper  begins  with  a  presentation  of  some  examples  that  illustrate  the  sort  of 
learning  to  be  explained.  Next,  there  is  a  review  of  a  representation  and  some  matching 
issues  developed  in  a  previous  paper  which  concentrated  on  establishing  two-situation 
correspondences  [Winston  1980].  And  finally  there  is  a  description  of  the  principle 
forming  and  indexing  ideas  that  enable  principles  to  be  created  and  stored.  There  are 
references  throughout  to  an  implemented  system  that  actually  does  reasoning,  principle 
forming,  and  indexing  using  precedents  and  exercises. 

The  implemented  system  has  a  number  of  key  ingredients,  the  following  in 
particular: 

■  Analogy-based  reasoning.  Analogy  is  based  on  the  assumption  that  if  two 
situations  are  similar  in  some  respects,  then  they  must  be  similar  in  other  respects 
as  well.  Here  the  causal  structure  of  the  precedent  situation  is  assumed  to  map 
onto  the  exercise  situation. 

■  Learned  If-then  rules.  In  contrast  to  current  practice  in  Knowledge  Engineering, 
if-then  rules  emerge  as  problems  are  solved.  Teachers  supply  precedents  and 
exercises,  leaving  the  work  of  formulating  the  if-then  rules  to  the  system. 

■  Actor-oriented  indexing.  In  contrast  to  current  practice  in  Problem  Solving, 
context  is  established  by  the  classes  of  the  actors  involved  in  problem  situations. 
This  is  effected  by  storing  the  learned  if-then  rules  according  to  the  classes  of  the 
actors  that  are  involved.  Irrelevant  if-then  rules  need  not  be  rejected  because  they 
are  never  accessed. 

■  Mixed  induction  and  deduction.  Under  certain  circumstances  a  relation  may  be 
assumed  if  it  both  explains  the  presence  of  some  existing  relations  and  allows  a 
new  relation  to  be  deduced. 

In  addition,  the  implemented  system  inherits  some  key  ingredients  from  previous  work: 

■  Actor-object  representation.  Situations  are  represented  using  relations  between 
pairs  of  situation  parts.  Supplementary  descriptions  can  be  attached  to  the 
relations  when  elaboration  is  needed. 
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■  Importance-dominated  matching.  The  similarity  between  two  situations  is 
measured  by  finding  the  best  possible  match  according  to  what  is  important  in  the 
situations.  Importance  is  determined  by  causal  connections  in  the  situations 
themselves.  Causal  connection  is  viewed  as  a  common  importance-determining 
constraint. 

The  system  works  in  domains  where  the  situations  satisfy  certain  criteria:  the  first 
is  that  each  situation  can  be  described  by  using  a  vocabulary  of  a  few  hundred 
properties,  classes,  acts,  and  other  relations;  the  second  is  that  one  situation  is  similar  to 
another  if  the  important  relations  in  their  descriptions  can  be  placed  in  correspondence; 
the  third  is  that  the  important  relations  of  each  situation  are  the  ones  explicitly  said  to 
be  important  by  some  teacher  or  implicitly  known  to  be  important  by  being  involved  in 
cause-effect  relations;  and  the  fourth  is  that  the  causes  in  similar  situations  generally 
lead  to  similar  effects.  The  system  will  not  work  in  domains  such  as  vision  and  speech 
where  different  descriptive  apparatus  is  necessary  and  where  different  regularities 
emerge. 

THE  COMPETENCE  TO  BE  UNDERSTOOD 

One  way  to  determine  if  work  in  Artificial  Intelligence  has  been  successful  is  to  use 
these  criteria:  first,  there  must  be  an  implemented  program  capable  of  performing 
specified  tasks;  and  second,  the  program  must  get  its  power  from  an  identified  set  of 
regularities  or  constraints.  The  regularities  or  constraints  constitute  the  competence  to 
be  understood. 

Let  us  begin,  then,  by  specifying  some  tasks  to  be  performed.  Consider  the 
following  precis  of  Macbeth,  given  by  a  teacher  as  a  precedent: 

In  MA  there  is  Macbeth  Lady-Macbeth  Duncan  and  Macduff.  Macbeth  is 
an  evil  noble.  Lady-Macbeth  is  a  greedy  ambitious  woman.  Duncan  is  a 
king.  Macduff  is  a  loyal  noble.  Macbeth  is  evil  because  Macbeth  is  weak 
and  because  Macbeth  married  Lady-Macbeth  and  because  Lady-Macbeth  is 
greedy.  Lady-Macbeth  persuades  Macbeth  to  want  to  be  king. 
Lady-Macbeth  influenced  Macbeth  because  Lady-Macbeth  is  greedy  and 
because  Macbeth  married  Lady-Macbeth.  Macbeth  murders  Duncan  with 
Lady-Macbeth  using  a  knife  because  Macbeth  wants  to  be  king  and  because 
Macbeth  is  evil.  Lady-Macbeth  kills  Lady-Macbeth.  Macduff  is  angry. 
Macduff  kills  Macbeth  because  Macbeth  murdered  Duncan  and  because 
Macduff  is  loyal. 

Next,  consider  the  following  exercise: 

In  EXERCISE-MA-1  there  is  a  man  and  a  woman.  The  man  married  the 
woman.  The  man  is  weak  and  the  woman  is  greedy.  Show  that  the  man  in 
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EXERCISE-MA-1  may  be  evil. 

Told  by  a  teacher  that  Macbeth  is  to  be  considered  a  precedent,  a  student  should 
establish  the  correspondence  between  the  man  and  Macbeth  and  between  the  woman 
and  Lady-Macbeth.  Next  the  student  should  announce  that  the  precedent  suggests  that 
the  inan  is  evil  in  the  sense  that  he  is  likely  to  commit  evil  acts.  Then  the  student 
should  form  a  principle-capturing  if-then  rule  suggesting  that  the  weakness  of  a  man  and 
the  greed  of  his  wife  can  cause  the  man  to  be  evil.  The  rule  should  be  accessible 
whenever  it  is  desired  to  see  if  there  is  reason  to  think  that  a  man  is  evil. 

Another  situation  is  described  and  another  question  is  posed  in  this  second 
example: 

In  EXERCISE-MA-2  there  is  a  noble  a  lady  a  prince  and  a  king.  The  noble 
married  the  lady.  The  noble  is  evil  and  the  lady  is  greedy  and  the  prince  is 
loyal.  Show  that  the  prince  in  EXERCISE-MA-2  may  kill  the  noble. 

Responding,  the  student  should  establish  appropriate  correspondences  as  before.  Then 
the  student  should  announce  that  the  prince  may  kilt  the  noble,  given  Macbeth  is  a 
precedent.  Then  the  student  should  create  a  rule  relating  the  evil  of  a  noble  and  the 
greed  of  his  wife  to  the  noble’s  death  at  the  hands  of  a  loyal  prince.  The  rule  should 
be  indexed  so  as  to  be  accessible  whenever  it  is  desired  to  show  that  a  prince  kills  a 
noble. 

There  is  an  implemented  program  that  behaves  as  the  student  does  in  these 
representative  examples,  doing  problem  solving  by  analogy,  rule  formation,  and  rule 
indexing  and  retrieving.  Thus  a  specified  task  is  performed  by  the  program,  satisfying 
the  first  criterion  for  success.  The  program  works  because  causal  connections  between 
relations  in  past  situations  tend  to  show  up  in  future  situations.  Thus  the  program 
works  because  it  exploits  an  identifiable  regularity,  satisfying  the  second  criterion  for 
success. 

So  far,  the  program  has  learned  about  two  dozen  simple  rules  using  toy-like 
precedents  and  exercises  from  Macbeth  World,  Medicine  World,  and  Politics  World. 

REPRESENTING  AND  MATCHING  SITUATIONS 

I  define  a  representation  to  be  a  vocabulary  of  symbols  together  with  some  conventions 
for  arranging  them  to  form  descriptions  of  objects  in  a  domain.  Some  desirable 
attributes  for  a  representation  are  that  it  makes  the  important  facts  explicit,  suppresses 
irrelevant  detail,  exposes  constraint,  and  can  be  computed  from  a  natural  input. 
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Actor-object  Representation 

The  particular  representation  used  in  this  work  is  based  on  two  key  assumptions:  first, 
that  what  needs  to  be  represented  can  be  expressed  in  simple  English;  and  second,  that 
much  of  what  can  be  expressed  in  simple  English  can  be  described  using  a  representation 
that  has  slots  for  both  a  relation  and  the  things  that  the  relation  ties  together. 

For  the  simplest  sentences,  the  things  involved  are  just  the  actor  and  the  object, 
and  the  relation  is  an  act.  For  others,  the  actor  and  object  are  supplemented  by  other 
things  that  participate  in  act  description,  such  as  an  instrument,  a  time  or  location,  or 
perhaps  a  source  or  destination  if  the  act  involves  motion.  In  the  following,  for 
example,  an  instrument  is  specified: 

Macbeth  murders  Duncan  with  a  knife. 

Knowing  the  kinds  of  things  that  are  involved  in  describing  an  act  and  understanding 
how  to  recognize  those  things  in  sentences  is  the  objective  of  case-grammar  theories  of 
sentence  meaning  [Fihnore  1968).  Actors,  objects,  instruments,  and  similar  terms  are 
used  as  names  for  case  slots.  Sentence  analysis  is  viewed  as  the  job  of  filling  case  slots 
using  sentences  as  raw  material. 

In  this  work,  the  actors  and  objects  in  situations  are  represented  graphically  as 
nodes  that  are  tied  together  with  acts  and  other  relations  forming  a  kind  of  semantic 
net.  When  more  than  an  actor  and  an  object  is  involved  in  an  act,  a  supplementary 
description  is  tied  to  the  act-specifying  relation,  making  the  representation  capable  of 
bearing  case-like  information.  The  supplementary  description  itself  consists  of  a  node 
related  to  other  nodes  as  illustrated  by  figure  1. 

Information  about  properties  and  classes  is  easily  conveyed  by  using  A-KIND-OF 
and  HAS-PROPERTY  relations.  Supplementary  description  nodes  can  be  attached  to 
A-KIND-OF,  HAS-PROPERTY,  and  other  relations  as  well  as  to  acts. 

Note  A  (all  notes  are  in  appendix  1)  goes  into  more  detail  about  the 
implementation  of  the  representation. 

English-like  Input  and  Simple  Deductions 

If  descriptions  are  produced  automatically  from  a  natural  input,  then  there  is  less  danger 
of  doing  all  the  real  work  before  the  computer  actually  gets  the  data.  Thus  descriptions 
in  the  actor-object  representation  should  be  computable  from  simple  English  descriptions 
or  from  something  that  is  at  least  close  to  simple  English.  Moreover,  a  translator  from 
English-like  descriptions  to  actor-object  descriptions  makes  experimental  work 
practicable. 

In  fact,  two  translators  have  been  designed  and  implemented:  a  simple  one,  easily 
modified  by  me,  for  current  use  and  a  more  powerful  one,  less  easily  modified  by  me, 
for  future  application.  The  simple  one  is  based  on  LIFER,  but  lacks  LIFER’S 
pronoun-handling  features  (Hendrix  ct  al.  1978],  The  other  one  is  the  work  of  Katz 
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Figure  1:  Supplementary  description  nodes  MURDER-1  and  KILL-2  carry  case-like 
information  supplementing  the  actor  and  object. 
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(1981).  The  Macbeth  example  was  given  in  the  form  that  the  simple  translator  handles. 
Note  B  illustrates  what  Katz’s  translator  can  do. 

The  use  of  natural  input  also  requires  a  way  to  make  some  simple  deductions  as 
sentences  are  read,  reducing  the  need  for  tedious  attention  to  details.  For  example, 
given  that  Macbeth  marries  Lady-Macbeth,  Lady-Macbeth  clearly  marries  Macbeth. 
Similarly  since  Macbeth  kills  Duncan,  it  is  clear  that  Duncan  is  dead.  Such  obvious 
deductions  are  done  in  the  implementation  by  a  few  demons  that  are  invoked  when 
relations  are  added  into  the  data  base. 

Matching  Establishes  Part  Correspondence 

Analogy  is  based  on  the  assumption  that  if  two  situations  are  similar  in  some  respects, 
then  they  must  be  similar  in  other  respects  as  well.  To  determine  if  two  situations  are 
similar,  the  parts  of  the  situations  must  be  placed  in  correspondence.  The  purpose  of 
matching  is  to  establish  the  best  way  to  do  this. 

The  performance  of  the  current  matcher  [Brotsky  1981),  is  described  in  note  C, 
along  with  definitions  and  uses  of  the  raw  scare  and  the  normalized  score.  The 
characteristics  of  the  matcher  are  as  follows. 
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■  The  matcher  searches  the  space  of  all  possible  matches  heuristically,  beginning  by 
linking  up  the  most  similar  parts  from  the  two  situations  and  then  moving  on  to 
those  that  are  less  similar.  The  parts  that  are  linked  supply  helpful  evidence  for 
linking  up  those  that  are  not. 

■  The  matcher  establishes  a  correspondence  between  the  parts  of  two  situations  using 
properties,  classes,  acts,  and  other  relations,  depending  on  what  is  important. 

■  The  matcher  can  be  forced  to  attend  exclusively  to  things  that  are  important. 

At  the  moment,  there  are  two  ways  to  determine  what  is  important.  One  way  is  to 
attribute  importance  to  all  relations;  the  other  is  to  attribute  importance  only  those 
relations  that  are  the  antecedent  or  consequent  of  a  causal  relation.  Note  D  describes 
the  various  words  implying  cause  and  shows  how  they  are  interpreted. 

The  reason  that  relations  connected  by  CAUSE  are  important  is  that  they  are, 
ipso  facto,  the  ones  involved  in  a  constraint  that  may  transfer  from  a  precedent  to  a 
new  situation. 


Cause  can  Bias  Matching  toward  Properties,  Classes,  or  Relations 

In  her  excellent  papers  on  analogy,  Gentner  observes  that  properties  and  classes  seem  to 
influence  correspondence  more  than  relations  when  people  are  beginners  in  a  problem 
domain  [Gentner  1980).  Later  on,  there  is  a  reversal:  relations  have  more  influence  than 
properties  and  classes. 

These  observations  may  have  to  do  with  cause-determined  importance.  Beginners 
in  a  domain  have  less  knowledge  about  what  causes  what  than  experts  do,  so  it  is  hard 
to  give  special  attention  to  any  particular  properties,  classes,  and  relations  when 
matching.  As  expert-level  performance  is  reached,  more  is  known  about  which 
properties,  classes,  and  relations  often  are  related  by  cause  and  effect,  making  it  possible 
let  those  things  weigh  heavily  in  matching.  Typically,  relations  are  more  often  involved 
in  cause  and  effect  than  properties  and  classes,  explaining  the  experts’  dependence  on 
relations. 

Cause  can  Bias  Matching  toward  Desired  Use 

Introspection  tells  us  that  the  way  things  are  matched  depends  on  purpose  as  well  as 
experience.  The  same  precedent  may  match  some  exercise  in  more  than  one  way 
depending  on  what  is  to  be  shown  or  explained.  It  is  easy  to  make  the  existing  matcher 
behave  this  way. 

As  it  stands,  the  mechanism  that  marks  relations  as  important  does  so  whenever 
they  appear  in  a  causal  chain.  A  bias-introducing  mechanism  could  mark  relations  only 
w’hen  they  appear  in  a  causal  chain  that  leads  to  some  specified  relation.  With  this,  it  is 
possible  to  construct  an  example  whereby  matches  with  Macbeth  go  different  ways 
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depending  on  whether  the  interest  is  in  why  Macbeth  is  evil  or  in  why  Macduff  is  loyal. 

REASONING  AND  CREATING  RULES  USING  ANALOGY 

How  is  it  possible  to  know  if  some  relation  holds  in  an  exercise,  given  that  the  exercise 
is  analogous  to  another,  well-understood  precedent?  The  answer  is  that  the  constraint 
relations  in  the  precedent  suggest  the  right  relations  to  check  and  the  right  questions  to 
ask.  Here  we  consider  only  constraint  involving  causal  connections.  The  key 
assumption  is  that  the  causal  structure  of  a  precedent  is  likely  to  say  something  about 
the  possible  causal  structure  in  an  exercise  to  be  analyzed. 

Causal  Relations  Enable  Common-sense  Reasoning 

Consider  the  Macbeth  precedent,  given  earlier,  together  with  the  following  exercise: 

In  EXERCISE-MA-1  there  is  a  man  and  a  woman.  The  man  married  the 

woman.  The  man  is  weak  and  the  woman  is  greedy.  Show  that  the  man  in 

EXERCISE-MA-1  may  be  evil. 

In  the  description  of  Macbeth ,  Macbeth  is  said  to  be  weak  and  his  wife,  Lady 
Macbeth,  greedy.  The  matching  program  uses  these  facts,  together  with  sex  classes,  to 
claim  correspondence  between  Macbeth  and  the  man  in  the  exercise  and  between  Lady 
Macbeth  and  the  woman.  The  matcher  finds  no  people  in  the  exercise  corresponding  to 
Duncan  or  to  Macduff. 

While  the  man  in  the  exercise  is  not  known  to  be  evil  already,  Macbeth  is. 
Moreover,  Macbeth  is  said  to  be  evil  for  reasons  that  hold  for  the  man:  both  are  weak 
and  both  are  married  to  someone  who  is  greedy.  Thus  insofar  as  Macbeth  is  a 

precedent  for  the  exercise,  it  seems  reasonable  for  the  common  reasons  to  lead  to  a 

common  effect:  the  man  may  be  evil. 

In  this  simple  illustration,  there  is  only  one  precedent  involved  and  there  is  only 
one  level  of  CAUSE  relations  in  that  precedent.  Naturally  the  implemented  system 
handles  more  general  situations.  To  be  more  precise,  the  following  steps  are  taken  when 
the  user  asks  about  some  relation  in  an  exercise  given  a  precedent: 

■  First,  the  relation  in  question  may  actually  be  in  the  exercise.  If  so,  no  further 
action  is  needed. 

■  Second,  the  relation  in  question  may  be  caused  by  other  relations  in  the  precedent. 
If  so,  try  to  establish  the  other  relations  in  the  exercise. 
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■  Third,  the.  relation  in  question  may  be  both  absent  from  the  exercise  and  causeless 
in  the  precedent.  If  so,  seek  another  precedent-establishing  precedent  to  work 
with. 

Thus  the  causal  structure  of  the  precedents  serve  as  a  template,  guiding  the  student  to 
the  possible  antecedents  of  the  relation  in  question. 

Examples  further  illustrate  how  these  rules  work.  In  figure  2,  assume  that  there  is  , 
enough  background  information,  in  the  form  of  properties,  classes,  and  other  relations 
not  shown,  to  establish  that  P-A-l  (for  precedent  agent  number  1_)  matches  best  with 
E-A-l  (for  evidence  agent  number  1J,  P-O-l  (for  precedent  object  number  1_)  with 
E-O-l,  and  so  on.  Given  this,  R1  is  justified  between  E-A-l  and  E-O-l  as  follows:  first, 
R1  in  the  precedent  is  caused  by  R2  between  P-A-2  and  P-O-2;  and  second,  R2  is  in 
place  between  E-A-2  and  E-O-2  in  the  exercise. 

The  example  of  figure  3  is  more  difficult  only  because  the  causal  chain  must  be 
chased  a  little  further.  R2  in  the  exercise  is  at  issue.  By  going  back  two  steps  in  the 
precedent’s  causal  chain  from  R2,  R4  is  encountered,  which  is  in  place  in  the  exercise. 
Other  relations  that  come  after  R2  and  before  R4  in  the  chain  are  ignored. 

Finally,  the  example  of  figure  4  goes  a  little  further  still  in  that  two  precedents  are 
needed.  Moving  back  through  the  causes  in  the  first  precedent,  P,  relation  R3  is 
encountered,  but  it  is  not  in  place  in  the  exercise,  nor  is  it  caused  by  another  relation. 
To  establish  R3,  it  is  necessary  to  tcse  another  precedent,  Q,  with  another  causal  chain 
that  can  be  exploited.  Here  the  causal  chain  of  the  other  precedent  leads  from  R3  to 
R5,  which  is  in  place,  thereby  justifying  both  R3  and  the  original  relation  at  issue,  Rl. 


P-A-l  - T-— ► 

t 

R2 

P-A-2  - ►  P-0-2 

PRECEDENT 


E-A-l 


E-O-l 


E-A-2  — --  E-0-2 

EXERCISE 


Figure  2:  An  example  illustrating  reasoning  by  analogy.  Relation  Rl  may  be  justified  in 
the  exercise  by  reason  of  the  causal  structure  of  the  precedent  and  the  known  relation, 
R2,  in  the  exercise.  Unlabeled  relations  are  CAUSE. 
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P-A-l 


PA  2 


P-A-3 


P-A-4 


P-A-5 


RI 

A 

R2 

T 

R3 

T 

R4 

A 

R5 


►  P-0- 1 


►  P-0-2 


►  P-0-3 


►  P-0-4 


►  P-0-5 


E-A-2  -  -  1  -  ►  K-0-2 


E-A-3  E-0-3 


E-A-4 - — — — ►  E-A-2 


PRECEDENT  EXERCISE 


Figure  3:  An  example  illustrating  reasoning  by  analogy  with  a  two-step  causal  chain. 
Relation  R2  may  be  justified  in  the  exercise  because  the  causal  chain  of  the  precedent 
leads  to  relation  R4,  which  is  in  a  corresponding  place  in  both  the  precedent  and  the  , 
exercise.  Unlabeled  relations  are  CAUSE. 


Reasoning  may  be  for  Justification  or  Prediction 

When  working  with  Macbeth  and  Exercise-ma-1 ,  the  use  of  precedent  was  for  justifying 
a  conclusion.  The  action  would  be  the  same  if  the  use  were  for  justifying  a  prediction. 
Indeed,  the  implemented  programs  cannot  know  the  difference  since  the  representation 
used  has  no  provision  for  denoting  past,  present,  and  future. 

There  is  some  implicit  sequence  information,  however,  since  the  the  word  because 
is  always  taken  to  imply  that  one  relation  contributes  to  the  existence  of  another  at  a 
later  moment.  In  unrestricted  English,  because  is  used  ambiguously.  In  "Macbeth  killed 
Duncan  because  Macbeth  was  evil,"  the  meaning  is  that  Macbeth’s  evil  quality  was  one 
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R  1 

P-A-l - -r-*~  P-O-l 


_  .  ,  R2 
P-A-2 - — ►  P-0-2 


R3 

P-A-3 - ►  P-0-3 


PRECEDENT  P 


R1 

Q-A-  3 - -l-^Q-0-3 


R4 

Q-A -4 - — ►  Q-0-4 


R5 

Q-A- 5 - ►  Q-0-5 


PRECEDENT  Q 


E-A-2 - ►  F.-02 


E-A-3 


E-0-3 


E-A-4 


E-0-5 


R  5 

E-A-5 - ►  E-0-5 


EXERCISE 


Figure  4:  An  example  illustrating  reasoning  by  analogy  with  two  precedents  needed. 
Working  on  relation  R2  in  the  exercise  requires  both  precident  P  and  precedent  Q. 
Unlabeled  relations  are  CAUSE. 
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of  the  things  that  contributed  to  the  murder;  in  "Macbeth  was  evil  because  Macbeth 
murdered  Duncan,"  the  meaning  is  that  Macbeth’s  murder  of  Duncan  forces  the 
conclusion  that  he  must  have  been  evil  beforehand. 

Common-sense  Reasoning  Generates  Rule-like  Principles 

One  way  to  explain  how  the  analogy-oriented  reasoning  process  works  is  to  note  that  the 
precedent  and  the  exercise  determine  an  AND  tree.  The  root  is  the  relation  to  be 
shown  in  the  exercise;  the  tips  are  relations  that  hold  in  the  exercise;  and  the  structure 
in  between  is  supplied  by  the  precedent. 

In  describing  a  precedent  and  constructing  an  exercise,  the  teacher  causes  attention 
to  be  drawn  to  a  particular  fragment  of  the  causal  structure  exhibited  in  the  precedent. 
One  reason  to  do  this  is  that  the  fragment  involved  may  be  worthy  of  special  notice. 
Indeed,  it  may  be  that  for  some  broad  classes  of  actors  and  objects,  the  relations  at  the 
AND  tree  tips  lead  to  the  relation  at  the  root  often,  not  just  in  the  precedent  and  the 
exercise. 

Suppose  that  a  new  situation  is  formed  from  the  relations  at  the  tips  and  at  the 
root  of  the  AND  tree.  Further  suppose  that  the  parts  involved  are  created  by  making 
instances  of  the  parts  in  the  exercise.  In  the  simple  example  using  Macbeth  and 
Exercise- m a-  /,  the  situation  synthesized  from  the  precedent  and  the  exercise  is 
illustrated  in  figure  5.  Note  that  the  synthesis  procedure  ties  all  the  tips  to  the  root 
directly  with  CAUSE  relations. 

■  Situations  synthesized  from  precedents  and  exercises  constitute  constraint-describing 
summaries  that  may  be  worth  remembering  as  principles. 

Displayed  in  another  notation,  these  principles  are  plainly  like  the  if-then  rules  that  are 
so  popular  in  Knowledge  Engineering: 

Rule 

RULE-1 

if 

t  MAN-4  HAS-QUALITY  WEAK  ] 
t  MAN-4  MARRY  WOMAN-2  ] 
t  WOMAN-2  HAS-QUALITY  GREEDY  ] 

then 

t  MAN-4  HAS-QUALITY  EVIL  ] 

case 

MA 

Since  these  rules  are  represented  internally  in  the  same  way  precedents  are,  they 
can  be  used  by  the  same  matching,  reasoning,  and  learning  machinery  that  works  for 
ordinary  precedents.  Thus  we  will  see  examples  in  which  old  rules  lead  to  new  ones. 

Figure  6  shows  how  the  synthesis  procedure  works  when  there  is  more  depth  to 
the  AND  tree. 
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EVIL 


EVIL 

♦ 

I  7 

i 

WEAK"— HQ - MAN-’  MARRY  *  W0MAN  I  '  HQ  »  OREEDY 

EXERCISE 


CAUSE 


WEAK-* 


MARRY 


►WOMAN-2 


■►GREEDY 


RULE _ _  _ 

Figure  5:  An  exercise  causes  part  of  the  causal  structure  of  the  precedent  to  be 
extracted,  forming  a  rule.  The  rule  is  in  the  same  representation  used  for  the  precedent 
and  the  exercise.  AKO  =  A-KIND-OF.  HQ  =  HAS-QUALITY. 
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Rules  may  have  varying  Certainty 

In  Expert  Systems  for  analysis,  each  rule  typically  has  some  number  associated  with  it 
that  indicates  how  reliable  it  is.  These  certainty  factors  are  used  as  the  system  is  run  to 
determine  the  certainty  of  the  analyses  produced. 

It  is  possible  to  create  such  certainty  factors  for  learned  rules  by  careful 
examination  of  the  precedents.  At  one  point,  a  qualitative,  possibly  human-like  scheme 
was  devised  and  implemented  to  do  this  examination.  Note  E  describes  what  happened. 

Why  Have  Rules? 

It  is  good  to  have  rules  for  several  reasons.  First,  the  cause-effect  knowledge  in  a  rule  is 
quite  explicit,  lacking  the  irrelevant  clutter  and  intermediate  reasoning  steps  of  the 
precedents  from  which  rules  are  derived.  Explicit  capture  of  the  essentials  is  one  of  the 
prime  desiderata  of  good  representation. 

Second,  it  is  easier  to  match  to  rules  than  to  match  to  their  precedents.  Rules 
typically  have  fewer  parts  and  fewer  properties,  classes,  and  other  relations.  Matching  a 
new  situation  against  a  rule  is  faster  and  less  likely  to  be  diverted  from  the  most  useful 
matching  result. 

Third,  rules  are  the  stuff  of  Knowledge  Engineering,  a  part  of  Artificial 
Intelligence  with  established  techniques  for  dealing  with  questions  about  why  a  certain 
conclusion  was  sought,  about  what  facts  were  involved  in  supporting  it,  and  about  what 
knowledge  was  involved. 

And  finally,  fourth,  rules  are  easy  to  index  and  retrieve,  as  we  shall  see. 

Why  Learn  Rules? 

It  is  also  good  to  learn  rules.  Again  there  are  a  number  of  reasons. 

First,  of  course,  rule  learning  is  interesting  for  its  own  sake.  What  is  it  about  the 
way  the  world  is  put  together  that  enables  us  to  capture,  summarize,  and  exploit  past 
experience?  What  are  some  particular  processes  for  doing  these  things?  Are  there 
others?  What  about  the  way  people  do  it?  What  about  Medicine,  Political  Science,  and 
Law? 

Second,  there  is  too  much  to  do.  We  need  systems  that  can  learn  rules  from 
precedents  because  the  traditional  process  of  extracting  rules  from  experts  is  too  slow 
and  too  expensive. 

Third,  getting  rules  from  experts  may  be  unreliable  because  the  existing  experts 
may  have  difficulty  verbalizing  the  rules  they  use,  even  though  they  may  be  able  to 
teach  the  subject  matter  by  citing  the  useful  precedents. 

And  fourth,  there  may  be  no  experts  because  a  discipline  is  too  new  or  too 
complicated. 
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Why  Have  Precedents? 

After  learning  a  rule,  it  is  good  to  keep  its  precedents  because  there  may  be  a  need  to 
reason  on  many  levels  of  detail.  Existing  expert  systems  have  only  knowledge  distilled 
from  the  heads  of  those  that  contribute  to  them.  The  systems  themselves  have  no  way 
of  asking  about  the  origins  of  their  own  knowledge,  a  defect  that  can  be  fatal  when  a  , 
rule  is  misapplied. 

In  contrast,  when  the  procedures  described  here  derive  a  rule,  the  precedents  used 
are  noted.  This  means  that  the  facts  behind  the  rules  can  be  examined  when  a  rule 
seems  to  lead  to  a  doubtful  conclusion.  Consider,  for  example,  the  following  exercise, 
again  to  be  used  with  Macbeth : 

In  EXERCISE-MA-2  there  is  a  noble  a  lady  a  prince  and  a  king.  1  he  noble 
married  the  lady.  The  noble  is  evil  and  the  lady  is  greedy  and  the  prince  is 
loyal.  Show  that  the  prince  in  EXERCISE-MA-2  may  kill  the  noble. 

Together  with  this  exercise,  Macbeth  dictates  the  construction  of  the  following  rule: 

Rule 

RULE -2 
If 

t  LADY-6  HAS-QUALITY  GREEDY  ] 

[  NOBLE-8  MARRY  LADY-6  ] 

[  NOBLE -8  HAS-QUALITY  EVIL  ] 

[  PRINCE-4  HAS-QUALITY  LOYAL  ] 

then 

[  PRINCE-4  KILL  NOBLE-8  ] 

case 

MA 

Now  consider  this  exercise,  which  closely  resembles  the  one  just  used  to  create  a  new 
rule: 

In  EXERCISE-MA-3  there  is  a  noble  a  lady  and  a  prince.  The  noble 
married  the  lady.  The  noble  is  evil  and  the  lady  is  greedy  and  the  prince  is 
loyal. 

The  difference  between  this  exercise  and  the  previous  one  is  that  there  is  no  king. 
Nevertheless,  analyzing  the  problem  in  the  light  of  the  rule  just  created,  one  finds  that 
the  match  is  good  and  that  the  analogy  procedure  is  satisfied:  it  seems  that  the  prince 
kills  the  noble.  Here  is  the  actual  trace  of  the  computation,  with  some  cosmetic 
deletions: 


t 
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Matching  EXERCISE-MA-3  against  RULE-2 

41.  values  match  with  48.  and  75.  possible. 

Normalized  score  is  85.  X 

I  note  that  [  LADY-Z  HAS-QUALITY  GREEDY  ]  for  use  with  RULE-2 
i  note  that  [  NOBLE-2  MARRY  LADY-Z  ]  for  use  with  RULE-2 

I  note  that  [  NOBLE-2  HAS-QUALITY  EVIL  ]  for  use  with  RULE-2 

I  note  that  (  PRINCE-Z  HAS-QUALITY  LOYAL  ]  for  use  with  RULE-2 

The  evidence  from  RULE-2  indicates  [  PRINCE-2  RILL  NOBLE-2  ] 

There  is  a  flaw,  however.  The  exercise  has  no  king  for  the  evil  noble  to  murder. 
Analyzing  the  problem  using  Macbeth,  rather  than  the  rule,  has  the  following  result: 

Matching  MA  against  EXERCISE-MA-3 

42.  values  match  with  184.  and  52.  possible. 

Normalized  score  is  80.  X 

Match  is  decisive  --  10.  better  than  next  best. 

I  note  that  [  PRINCE-Z  HAS-QUALITY  LOYAL  ]  for  use  with  HA 

Beware!  Use  of  match  required  creating  RING-7  for  DUNCAN 

I  note  that  [  NOBLE-2  HAS-QUALITY  EVIL  ]  for  use  with  MA 

I  note  that  [  NOBLE-2  MARRY  LADY-2  ]  for  use  with  MA 

I  note  that  [  LADY-Z  HAS-QUALITY  GREEDY  ]  for  use  with  MA 
The  evidence  from  MA  indicates  [  PRINCE-2  RILL  NOBLE-2  ] 

The  line  beginning  with  beware  is  the  important  one  because  it  warns  that  some  object 
in  the  exercise,  possibly  vital,  is  missing  and  must  be  conjectured.  In  this  example,  it 
can  be  argued  that  a  really  smart  system  would  know  there  must  be  someone  for  the 
prince  to  be  loyal  to.  The  point,  however,  is  that  it  is  possible  to  follow  up  on  doubted 
conclusions.  The  first  step  is  to  follow  the  trail  from  the  doubted  conclusion  back 
through  the  rule  involved  to  the  governing  precedent  from  which  the  rule  was  derived. 
The  second  step  is  to  use  the  precedent  for  analysis  rather  than  the  rule. 

The  rule  used  for  [  PRINCE-2  RILL  NOBLE-2  ]  is  RULE-Z 
The  precedent  for-RULE-2  is  MA 
Matching  MA  against  EXERCISE-MA-3 


Beware!  Use  of  match  required  creating  RING-7  for  DUNCAN 


Another  possibility  is  that  some  part  of  the  causal  chain  in  the  precedent  may  be 
flawed,  rarely  likely,  or  inapplicable.  Having  the  precedent  handy  means  that  these 
possibilities,  in  principle,  could  be  pursued. 

■  The  key  idea  is  that  the  precedents  that  support  the  rules  can  be  examined  in  a 
variety  of  ways,  on  demand,  unlike  those  of  current  Knowledge  Engineering,  which 
lie  inside  the  human  expert.  The  intermediate  steps  leading  from  causes  to  effects 
can  be  examined  and  questioned.  It  becomes  possible  to  reason  coherently  at  more 
than  one  level.  The  knowledge  is  more  open,  with  less  of  a  compiled  flavor. 


Patrick  H.  Winston 


-  17  - 


Creating  Rules 


INDEXING  AND  RETRIEVING  RULES 

Systems  with  general  intelligence  will  have  to  reason  about  all  sorts  of  things,  raising  the 
question  of  how  to  cope  when  there  are  many  domains  to  think  about  and  when  the 
combined  number  of  rules  gets  substantially  beyond  the  two  or  three  hundred  that 
constitute  a  large  expert  system  today.  Somehow  things  must  be  organized  so  that  it  is 
not  necessary  to  consider  the  rules  governing  greed  when  dealing  with,  say,  an 
unconscious  diabetic. 

A  natural  idea  is  that  the  rules  must  be  grouped  with  context  deciding  which 
groups  should  be  considered  in  any  given  situation.  But  this  idea  raises  questions.  What 
are  the  natural  groups?  Is  it  possible  to  fix  them  in  advance?  Is  it  possible  to  discover 
them  while  acquiring  the  rules?  What  determines  context?  How  does  context  establish 
that  a  rule  group  is  active? 

Class  Determines  Storage  and  Access 

Recall  again  that  the  precedent  involving  Macbeth  and  the  exercise  involving  a  man 
resulted  in  a  rule  involving  a  man,  inasmuch  as  the  corresponding  object  in  the  exercise 
was  a  man.  Thus  the  classes  of  the  objects  involved  in  rules  is  under  the  control  of  the 
teacher  who  supplies  the  exercises. 

It  seems  reasonable  to  assume  that  a  rule  about  a  man  may  be  useful  in 
establishing  something  about  man,  a  noble,  or  anything  else  that  is  a  kind  of  man.  It  is 
not  so  reasonable  to  assume  that  a  rule  about  a  noble  will  be  useful  in  establishing 
something  about  a  man  or  anything  else  that  a  noble  is  a  kind  of.  Thus  we  have  the 
following  principle: 

■  Rules  whos?  conclusion  involves  some  particular  actor  and  object  classes  should  be 
stored  so  that  they  may  be  accessed  when  those  same  classes  are  involved  in  a 
question. 

With  a  view  toward  reasoning  by  backward  chaining,  one  way  to  store  rules  is  by 
sorting  them  into  buckets  keyed  by  the  class  of  the  actor  in  the  conclusion,  then  by  the 
act,  and  then  by  the  class  of  the  object.  In  the  implementation,  each  rule  ends  up  in  a 
multilevel  association  list  stored  in  the  frame  describing  the  actor’s  class.  Figure  7 
illustrates. 

For  retrieving,  there  is  a  complementary  principle: 

■  Questions  that  involve  some  particular  actor  and  object  classes  should  cause  access 
to  rules  whose  conclusion  involves  actors  and  objects  of  those  same  classes. 


♦ 


In  the  implementation,  the  classes  that  the  actor  in  the  question  is  a  kind  of  are 
examined  starting  with  the  most  general  and  progressing  to  the  most  specific.  All  the 
rules  associated  with  a  given  class  are  tested  to  see  if  the  act  is  the  same  as  that  in  the 
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PRINCE  /v/  [PRINCE  KILL  NOBLEJ  RULE-2 

t 

AKO 


Figure  7:  A  rule  is  stored  according  to  the  class  of  the  actor  involved  in  the  then  part 
of  the  rule.  Further  indexing  is  done  using  the  relation  and  the  class  of  the  object. 


question  and  if  the  object  class  is  something  that  the  object  in  the  question  is  a  kind  of. 
If  all  tests  are  satisfied  for  any  rule,  the  rule  is  tried.  For  all  those  involving  actors  of 
the  same  class,  the  most  recently  created  is  tried  first,  on  the  weak  ground  that 
increasing  knowledge  makes  rule  formation  more  reliable. 

A  rule  may  fail,  of  course.  The  indexing  and  retrieving  apparatus  simply  makes 
rule  application  contingent  on  two  hurdles,  rather  than  just  one:  first  the  rule  must  be 
found,  and  second  the  if  part  of  the  rule  must  be  compatible  with  the  current  situation. 
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Class  Establishes  Context 

Part  classes  determine  context  since  part  classes  determine  what  rules  can  be  tried. 
Rules  about  nobles  are  for  situations  involving  nobles,  and  rules  about  diabetics  for 
situations  involving  diabetics.  The  same  person  may  be  described  in  one  situation  as  a 
noble  and  in  another  as  a  diabetic,  with  the  sensible  context  established  and  the  sensible 
rules  tried  automatically. 

Storage  and  Access  Needs  Suggest  Speculations 

As  the  moment,  classes  are  linked  together  to  form  a  tree,  providing  access  to  the  rules. 
Rules  are  tried  top  down,  working  from  the  more  general  actor  classes  toward  the  more 
specific.  More  work  is  required  to  determine  if  top-down  access  is  really  better  than 
bottom-up.  The  argument  for  top-down  access  is  that  the  rules  with  the  most  general 
actor  classes  involved  will  be  the  most  reliable.  An  argument  for  bottom-up  access  is 
that  rules  with  actors  that  are  most  like  the  actors  in  the  situation  in  hand  will  be  the  > 
most  reliable. 

Warrington's  top-down,  thread-like  accessing.  Interestingly,  the  experiments  of 
Elizabeth  Warrington  seem  to  suggest  that  human  semantic  memory  access  is  top-down 
[1975].  Warrington’s  memory  model  is  not  tree  oriented,  however.  Instead,  her  model 
is  one  of  individual,  nonintersecting  classification  threads,  one  for  each  object. 

Switching  to  threads  might  help  solve  the  problem  of  handling  exceptions 
introduced  by  top-down  access.  With  either  threads  or  .trees,  bottom-up  access  finds  the 
most  specific  knowledge  first,  effectively  masking  out  more  general  knowledge  that  may 
not  apply  in  unusual  situations.  There  is  no  such  masking  effect  with  top-down  access: 
it  is  necessary  to  look  beyond  the  first  rule  encountered  to  check  for  any  indication  that 
the  rule  does  not  apply-  But  with  individual  threads  for  each  object,  classes  holding 
inappropriate  knowledge  with  respect  to  some  individual  need  not  be  included  in  that 
individual’s  thread,  even  though  normally  part  of  a  classification  hierarchy.  It  is  not 
necessary,  for  example,  to  include  BIRD  in  the  threads  of  all  birds.  Consequently,  there 
need  be  no  exception  information  for  rules  about  flying  for  penguins. 

Rosch’s  basic  level.  It  would  be  natural  for  most  of  the  rules  to  end  up  in  the 
middle  level  of  the  class  hierarchy.  On  working  with  Shakespeare,  a  system  would  learn 
some  things  about  nobles,  less  about  people  in  general,  and  much  less  about  thanes. 
Thus  rule-learning  theory  offers  a  possible  explanation  for  a  phenomenon  observed  by 
Rosch  and  her  colleagues:  there  seems  to  be  an  information-rich  basic  level  in  the  class 
hierarchy;  being  more  specific  does  not  add  much;  and  being  less  specific  leaves  one 
knowing  little  [Rosch  1976].  We  know  a  lot  about  apples;  it  does  not  help  much  to 
know  we  have  a  Macintosh  apple;  and  there  is  not  much  to  know  about  fruits  in 
general. 

Rules  as  constraints  on  hierarchy.  Little  is  known  about  what  classes  there  should 
be  and  about  when  and  how  new  classes  should  be  formed.  It  can  be  that  thinking 
about  rule  indexing  and  retrieving  can  help  us  find  the  determining  constraints.  For  one 
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thing,  class  refinement  may  reduce  the  number  of  times  a  rule  is  found  but  cannot  be 
used.  It  may  be  easy  to  push  such  an  overtried  rule  into  a  subclass  or  to  create  a  new 
subclass  for  it  by  noting  exactly  how  the  rule  fails.  New  subclass  creation  would  be 
natural  as  one  becomes  an  expert  in  a  domain,  learning  many  new  rules  of  increasing 
specificity. 

Rules  as  intermediates.  It  is  hard  to  get  rules  out  of  some  experts,  raising  doubt 
about  whether  they  really  use  them  at  all.  Doctors,  in  particular,  seem  to  dislike  having 
their  knowledge  put  into  rules.  Often  they  will  talk  of  having  a  "feel"  for  a  case  that 
seems  to  involve  more  than  those  characteristics  that  would  be  in  causal  chains  and 
hence  in  rules. 

One  argument  is  that  people  use  rules,  but  have  difficulty  articulating  them. 
Another  is  that  people  do  not  use  rules  at  all,  but  somehow  work  with  partly 
remembered,  partly  forgotten  cases  from  school  and  practice. 

There  is  still  another  possibility,  however.  Boris  Katz  notes  that  a  rule  may  just 
miss  applying  while  its  precedent  applies  perfectly  [conversation].  He  observes  that  it 
makes  heuristic  sense  to  check  the  precedent  when  a  rule’s  then  part  and  many  of  its  if 
parts  match  the  current  problem.  Katz  has  suggested  the  term  near  match  for  these 
situations.  Indeed,  it  may  be  that  the  rules  are  not  used  as  "rules,"  but  rather  as 
"abstracts."  After  all,  rules  summarize  a  way  in  which  a  precedent  can  be  used.  If  an 
exercise  matches  most  the  if-then  parts  of  a  rule,  then  the  precedent  from  which  the 
rule  was  derived  may  be  a  good  precedent.  Earlier  discussion  suggested  that  it  is  always 
possible  to  go  back  to  a  precedent  if  an  application  of  a  derived  rule  gives  a  suspicious 
result.  Here  the  suggestion  is  that  going  back  may  be  the  normal  way,  using  the 
rule-like  summary  only  to  do  indexing  and  retrieving. 

Establishing  classes  using  relations.  In  a  sense,  using  classes  to  establish  context  just 
pushes  the  context  problem  back  a  bit,  to  the  question  of  how  classes  are  established. 
Of  course  classes  often  are  given  in  a  problem  statement.  Otherwise  they  may  be 
deduced  by  rules  from  existing  relations:  sons  of  nobles  are  nobles;  and  people  whose 
pancreases  are  bad  are  diabetics.  Of  course  current  context  determines  which  rules  are 
available  for  establishing  classes  using  relations,  thus  suggesting  the  loop  illustrated  in 
figure  8. 

Note,  incidentally,  that  bias  can  be  introduced  by  giving  the  problem  solver 
inappropriate  class  information.  This  may  have  an  analog  in  human  reasoning.  It 
makes  sense  to  use  words  like  accused  before  words  like  murderer  because  a  jury  will 
think  about  people  in  ways  determined  by  the  classes  that  are  assumed. 

MACBETH,  POLITICS,  AND  DIABETES 

About  two  dozen  rules  have  been  generated.  Some  are  discussed  in  this  section  to 
illustrate  additional  points.  Keep  in  mind  that  the  performance  of  the  system  has  to  be 
judged  in  the  light  of  the  knowledge  in  the  given  precedents.  A  complete  trace  is  given 
in  appendix  2. 
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Forward-chaining  rules  use 
relations  to  establish  classes 
and  thereby  broaden  context. 


Backward-chaining  rules  made 
available  by  broadened  context 
establish  relations  in  res|K>nse 
to  questions. 


Figure  8:  Class,  context,  and  relations  interact. 


Generating  Rules  from  other  Rules  -  Macbeth  World 


In  this  experiment,  two  rules  are  used  to  produce  another.  One  is  RULE-1,  seen  before: 
Rule 

RULE-1 

if 

[  MAN-4  HAS-QUALITY  WEAK  ] 

[  MAN-4  MARRY  WOMAN-2  ] 
t  WOMAN-2  HAS-QUALITY  GREEDY  ] 

then 

[  MAN-4  HAS-QUALITY  EVIL  ] 

case 

MA 

Another  is  derived  from  the  following  exercise: 


In  EXERCISE-MA-4  there  is  a  man.  The  man  is  evil.  The  man  wants  to  be 
king.  In  exercise-ma-4  there  is  a  king.  Show  that  the  man  in 
EXERCISE-MA-4  may  murder  the  king. 

Which  produces  this: 
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Rule 

RULE-3 

If 

[  MAN -5  WANT  [  MAN -5  AKO 

KING  ]  ] 

[  MAN-5  HAS-QUALITY  EVIL 

1 

then 

t  MAN-5  MURDER  KING-8  ] 

case 

ha 


Now  consider  the  following  exercise: 


In  EXERCISE-MA-5  there  is  a  noble  and  a  lady.  The  lady  is  greedy  and  the 
noble  is  weak.  The  noble  wants  to  be  king.  In  exercise-ma-5  there  is  a  king. 
Show  that  the  noble  in  EXERCISE-MA-5  may  murder  the  king. 


To  do  the  analysis,  as  shown  by  the  following  trace,  both  rules  are  retrieved  using 
the  class-oriented  scheme.  In  addition,  one  question  is  answered  directly  by  the 
experimenter.  Of  course,  either  rule  could  have  been  replaced  by  a  direct  use  of  the 
precedent  from  which  it  was  formed. 

I  am  trying  to  show  [  NOBLE-3  MURDER  ICING-3  ] 

Supply  t  =  true,  ?  =  don't  know,  1  =  look,  or  a  precedent: 

>  1 

For  [  NOBLE -3  MURDER  KING -3  ] 

I  use  Indexes  in  NOBLE-3  NOBLE  KING  MAN  RULER  PERSON 
and  I  have  discovered:  RULE-3 
Matching  EXERCISE-MA-5  against  RULE-3 
39.  values  match  with  55.  and  52.  possible. 

Normalized  score  is  75.  Y. 

Match  is  decisive  --  29.  better  than  next  best. 

I  note  that  [  NOBLE-3  WANT  [  NOBLE-3  AKO  KING  ]  ]  for  use  with  RULE-3 
To  use  RULE-3  I  need  to  know  if  [  NOBLE-3  HAS-QUALITY  EVIL  ] 

I  am  trying  to  show  [  NOBLE-3  HAS-QUALITY  EVIL  ] 

Supply  t  =  true,  ?  =  don't  know,  1  =  look,  or  a  precedent: 

>  1 

For  [  NOBLE -3  HAS-QUALITY  EVIL  ] 

I  use  indexes  in  NOBLE-3  NOBLE  KING  MAN  RULER  PERSON 
and  I  have  discovered:  RULE-1 
Matching  EXERCISE-MA-5  against  RULE-1 
12.  values  match  with  55.  and  45.  possible. 

Normalized  score  is  26.  % 

Match  is  decisive  --  4.  better  than  next  best. 

I  note  that  [  NOBLE-3  HAS-QUALITY  WEAK  ]  for  use  with  RULE-1 
To  use  RULE-1  I  need  to  know  if  [  NOBLE-3  MARRY  LADY-3  ] 

I  am  trying  to  show  [  NOBLE-3  MARRY  LADY-3  ] 

Supply  t  =  true,  ?  =  don't  know,  1  =  look,  or  a  precedent: 

>  t 

I  note  that  [  LADY-3  HAS-QUALITY  GREEDY  ]  for  use  with  RULE-1 
The  evidence  from  RULE-1  indicates  [  NOBLE-3  HAS-QUALITY  EVIL  ] 

The  evidence  from  RULE -3  indicates  [  NOBLE-3  MURDER  KING-3  ] 
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Rule  RULE-4  Is  derived  from  RULE-3  RULE-1  and  looks  like  this: 

Rule 

RULE-4 

If 

[  LADY-7  HA5-QUALITY  GREEDY  ] 

[  NOBLE-9  M/ARRY  LADY-7  ] 

[  NOBLE-9  HAS-QUAL1TY  WEAK  ] 

[  NOBLE-9  WANT  [  NOBLE-9  AKO  RING  ]  ] 

then 

[  NOBLE-9  MURDER  KING-9  ] 

case 

RULE-3  RULE-1 
Should  I  index  it? 

>  y 

Noting  that  [  NOBLE  MURDER  KING  ]  in  NOBLE  suggests  RULE-4  for  THEN 

In  the  example,  one  if  part  of  RULE-1  is  replaced  by  the  if  parts  of  RULE-1,  and 
the  classes  are  specialized  to  LADY  and  NOBLE.  Thus  the  new  rule,  RULE-4,  has  a 
larger  if  part  than  those  of  the  rules  it  is  based  on.  Not  enough  has  been  done  to 
speculate  on  whether  a  trend  toward  larger  and  larger  if  parts  will  emerge  and  become 
a  problem.  (Note  that  it  is  easy  to  construct  other  examples  in  which  rules  collapse 
together  when  common  causes  are  discovered  for  things  in  the  if  parts.) 

■  The  purpose  of  the  example  is  to  illustrate  that  new  learning  can  be  built  on  top 
of  old.  The  material  for  a  new  rule  can  come  from  a  mixture  of  retrieved  rules 
and  specified  precedents  as  the  situation  demands.  Several  rules  and  precedents 
may  be  needed  to  do  something  complicated. 


Examples  from  Politics  World 

Consider  the  following  description: 

i 

m 

In  WW  there*  are  Germany  Hitler  Poland  and  England.  Germany  is  an 
misled  country.  Hitler  is  a  greedy  ambitious  dictator.  Poland  owns  Poland. 
England  is  a  loyal  country  Germany  is  misled  because  Germany  is  weak  and 
because  Hitler  ruled  Germany  and  because  Hitler  is  greedy.  Hitler  persuades 
Germany  to  want  to  own  Poland.  Hiller  influenced  Germany  because  Hitler 
is  greedy  and  because  Hitler  ruled  Germany.  Germany  attacks  Poland  with 
Hitler  using  some  tanks  because  Germany  wants  to  own  Poland  and  because 
Germany  is  misled.  Poland  is  a  victim-country.  England  is  angry.  England 
attacks  Germany  because  Germany  attacked  Poland  and  because  England  is 
loyal.  Germany  is  defeated  because  England  attacks  Germany.  Hitler  kills 
Hitler. 

It  may  seem  familiar,  for  it  was  constructed  by  word  substitution  and  minor 
modification  from  Macbeth.  Consequently  all  the  Macbeth  exercises  have  parallels  too. 
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the  following  for  example: 

In  EXERCISE-WW-1  there  are  a  country  and  a  dictator.  The  dictator  ruled 
the  country.  The  country  is  weak  and  the  dictator  is  greedy.  Show  that  the 
country  in  EXERCISE- WW-1  may  be  misled. 


The  evidence  from  WW  Indicates  [  COUNTRY-1  HAS-QUAIITY  MISLED  ] 
Rule  RULE-15  is  derived  from  WW  and  looks  like  this: 

Rule 

RULE- 15 
if 

[  COUNTRY -7  HAS-QUALITY  WEAK  ] 

[  DICTATOR-8  RULE  COUNTRY-7  ] 
t  DICTATOR-8  HAS-QUALITY  GREEDY  ] 

then 

t  COUNTRY-7  HAS-QUALITY  MISLED  ] 

case 

WW 


Indexing  and  Retrieving  with  Parts  --  Diabetes  World 


In  this  example,  a  medical  case,  parts  of  things  are  involved: 


In  Cl  there  is  John.  John  is  a  patient  and  a  diabetic.  John's  blood  is  some 
blood.  The  blood’s  blood-sugar  is  high  because  the  blood’s  blood-insulin  is 
low.  The  blood-insulin  is  low  because  John’s  pancreas  is  unhealthy.  John  is 
a  diabetic  because  John's  pancreas  is  unhealthy.  John’s  heart  is  unhealthy 
because  the  blood-sugar  is  high.  John  takes  some  medicine-insulin  because 
the  blood-insulin  is  low.  John  needs  to  take  the  medicine-insulin  because  it  is 
bad  that  the  blood’s  blood-insulin  is  low  and  because  John's  taking  of  the 
medicine-insulin  prevents  the  blood’s  blood-insulin  being  low. 


In  C2  there  is  Tom  and  some  medicine-insulin.  Tom  is  a  diabetic.  Tom’s 
blood  is  some  blood.  The  blood’s  blood-sugar  is  high.  The  blood’s 
blood-insulin  is  some  blood-insulin.  In  C2  show  that  Tom’s  heart  is 
unhealthy. 


Patrick  H.  Winston 


-  25  - 


Examples 


I  am  trying  to  show  [  HEART-Z  HAS-QUALITY  UNHEALTHY  ] 

Supply  t  =  true,  ?  =  don't  know,  1  =  look,  or  a  precedent: 

>  cl 

Matching  Cl  against  CZ 

46.  values  match  with  151.  and  53.  possible. 

Normalized  score  is  86.  X 

Match  is  decisive  --  Z.  better  than  next  best. 

I  note  that  [  BLOOD-SUGAR-Z  HAS -QUALITY  HIGH  ]  for  use  with  Cl 
The  evidence  from  Cl  indicates  [  HEART-Z  HAS-QUAL1TY  UNHEALTHY  ] 
Rule  RULE-31  is  derived  from  Cl  and  looks  like  this: 

Rule 

RULE-31 

if 

[  BLOOD-SUGAR-4  HAS-QUALITY  HIGH  ] 

then 

[  HEART-3  HAS-QUALITY  UNHEALTHY  ] 

case 

Cl 


There  are  so  many  parts  of  John  and  parts  of  those  parts  that  it  is  much  faster  to  do 
the  exercise  problem  with  the  discovered  rule  than  with  the  original  case: 

In  C2  verify  that  Tom’s  heart  is  unhealthy. 


I  am  trying  to  show  [  HEART-2  HAS-QUALITY  UNHEALTHY  ] 

Supply  t  =  true,  ?  =  don't  know,  1  =  look,  or  a  precedent: 

>  1 

For  [  HEART-Z  HAS-QUALITY  UNHEALTHY  ] 

I  use  indexes  in  TOM  DIABETIC  PATIENT  PERSON 

and  I  have  discovered:  RULE-31 

Matching  C2  against  RULE-31 

27.  values  match  with  54.  and  54.  possible. 

Normalized  score  is  50.  X 

Match  is  decisive  --  6.  better  than  next  best. 

I  note  that  f  BLOOD-SUGAR-Z  HAS-QUALITY  HIGH  ]  for  use  with  RULE-31 
The  evidence  from  RULE-31  indicates  [  HEART-2  HAS-QUALITY  UNHEALTHY  ] 

Note  also  that  the  indexing  places  the  entry  under  DIABETIC,  not  HEART.  The 
result  is  that  the  rule  will  be  found  whenever  it  is  desired  to  show  that  the  heart  of  a 
diabetic  is  unhealthy,  not  whenever  it  is  desired  to  show  that  any  heart  is  unhealthy.  In 
general,  when  working  with  actors  that  are  parts  of  something,  it  seems  sensible  to  chase 
the  PART-OF  relations  to  the  end  and  store  in  what  is  found.  Figure  9  illustrates. 

Reasoning  by  Covering  An  Antecedent  --  Diabetes  World 

Consider  figure  10.  A  precedent  suggests  that  a  relation  leads  to  a  number  of 
consequents.  A  number  of  relations  in  the  exercise  parallel  those  in  the  tree  of 
precedent  consequents.  These  parallel  relations  are  situated  such  that  the  tree  would  be 
said  to  be  satisfied  if  it  were  an  AND  tree.  The  CAUSE  relations  point  the  wrong 
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4 


PERSON 

4 


PATIENT 

4 


DIABETIC  /v'  (HEART  HAS  QUALITY  UNHEALTHY]  RULE-7 


Figure  9:  The  rule  for  unhealthy  hearts  is  stored  under  DIABETIC  since  the  unhealthy 
heart  used  to  construct  the  rule  was  part  of  a  diabetic. 


way,  however,  so  the  tree  is  not  an  AND  tree. 

Still  there  is  some  heuristic  evidence  that  the  root  relation  holds  in  the  exercise, 
for  it  is  capable  of  explaining  all  of  the  known  relations  according  to  the  precedent.  Let 
us  say  that  the  tree  is  covered. 

Indeed,  even  if  one  of  the  covering  relations  is  the  relation  to  be  shown,  it  still 
may  make  sense  to  assume  the  root  relation,  since  it  seems  natural  and  human-like  to 
seek  complete,  tidy  explanations. 

The  need  for  this  came  up  in  a  diabetes  experiment: 

In  C2  show  that  Tom  takes  the  medicine-insulin. 
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PRECEDENT 


EXERCISE 


R1 
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Figure  10:  One  relation  in  the  precedent  leads  to  a  number  of  consequences,  some  of 
which  are  mirrored  in  the  exercise.  In  this  illustration,  R3,  R4,  and  R9  are  said  to 
cover  RJ. 


I  am  trying  to  show  [  TOM  TAKE  MEDICINE- INSULIN-2  ] 

Supply  t  =  true,  ?  =  don't  know,  1  =  look,  or  a  precedent: 

>  cl 

Should  I  use  the  last  match  between  C2  and  Cl  ? 

>  y 

Beware!  Use  of  match  required  creating  PANCREAS-2  for  PANCREAS-1 

I  note  that  [  BLOOD-SUGAR-2  HAS-QUALITV  HIGH  ]  for  use  with  Cl 

I  note  that  [  TOM  AKO  DIABETIC  ]  for  use  with  Cl 

All  consequences  of  [  PANCREAS-2  HAS-QUALITY  UNHEALTHY  ] 
are  confirmed. 

The  evidence  from  Cl  indicates  f  TOM  TAKE  MEDICINE- INSULIN-2  ] 

It  is  concluded  that  the  patient  needs  to  take  insulin  even  though  the  precedent’s  causal 
chain  leading  to  taking  insulin  includes  only  low  insulin  and  an  unhealthy  pancreas, 
neither  of  which  are  established  in  the  exercise.  The  unhealthy  pancreas  can  be 
reasonably  assumed,  however,  since  it  is  covered  by  a  combination  of  existing  relations 
and  the  relation  to  be  shown.  The  covering  relations  are  that  Tom  is  diabetic,  that  he 
has  high  blood  sugar,  and  that  he  takes  insulin.  All  these  covering  relations  appear  in 
the  resulting  rule: 
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Rule 

RULE- 32 
if 

t  DIABETIC-Z  AKO  DIABETIC  ] 

[  BLOOD-SUGAR-5  HA5-QUALITV  HIGH  ] 

then 

t  DIABETIC-2  TAKE  MEDICINE- INSULIN-3  ] 

case 

Cl 

OPEN  QUESTIONS 

It  is  plain  that  this  work  is  only  a  beginning.  The  next  iteration  through  thinking  and 
implementation  and  experiment  should  be  more  ambitious,  dealing  with  weaknesses  like 
the  following  representative  ones: 

■  There  is  no  way  to  criticize  a  rule.  Davis  showed  how  the  typical  member  of  a 
rule  group  can  be  used  to  suggest  additions  to  a  newly  acquired  rule  supplied 
directly  by  a  human  expert  [1979],  There  may  be  a  way  to  use  something  like 
Davis’s  ideas  with  automatically  generated  rules. 

■  There  is  no  way  to  handle  degree  of  certainty  of  cause.  Moreover,  there  is  no 
way  to  handle  subcategories  of  cause  such  as  those  sketched  by  Rieger  (1976]. 
Distinguishing  between  things  like  enablement  causes  and  main  causes  could  make 
rule  formation  and  rule  indexing  and  retrieving  better. 

■  There  is  no  way  to  handle  constraints  about  quantities  such  as  those  constraints 
that  appear  in  the  work  of  Forbus  (1981). 

■  There  is  no  parallel  to  actor  and  object  heirarchy  for  acts.  Thus  there  is  no 
satisfying  way  to  represent  the  fact  that  hit  and  kick  both  imply  contact.  Demons 
help  to  some  extent,  but  problems  remain. 

■  There  is  no  way  to  summarize  an  episode  in  a  story  so  as  to  make  a  general  precis. 

■  There  are  no  satisfying  ideas  about  the  role  of  abstraction  in  doing  matching  and 
indexing  and  retrieving. 

■  The  representation  for  time  is  impoverished.  Similarly  quantification,  negation, 
disjunction,  and  perspective  are  missing. 
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CONCLUSION:  SIMPLE  IDEAS  HAVE  PROMISE 

This  paper  is  about  a  set  of  ideas  that  enable  learning  and  reasoning  to  take  place  by 
analogy  in  domains  that  satisfy  certain  restrictions: 

■  The  situations  in  the  domain  can  be  represented  by  the  relations  between  the  parts 
together  with  the  classes  and  properties  of  those  parts. 

■  The  importance  of  a  part  of  a  description  is  determined  by  the  constraints  it 
participates  in. 

'■  Constraints  that  once  determine  something  will  tend  to  do  so  again. 

Things  that  involve  spatial,  visual,  and  aural  reasoning  do  not  seem  to  satisfy  the 
restrictions.  Things  that  involve  Management,  Political  Science,  Economics,  Law,  and 
Medicine  do  seem  to  satisfy  the  restrictions,  however,  and  are  targets  for  the  learning 
and  reasoning  ideas-  developed  here: 

■  Actor-object  representation. 

■  Importance-dominated  matching. 

■  Analogy-based  reasoning. 

■  Learned  if-then  rules. 

• 

■  Actor-oriented  indexing. 

■  Deduction  by  covering  an  antecedant. 

It  is  now  clear  that  simple  exercises  can  be  done  by  way  of  analogy  with  precedents. 
Rules  can  be  created  at  the  same  time,  and  they  can  be  indexed  and  retrieved  using  the 
classes  of  the  objects  involved.  Experience  informs,  or  at  least  prejudices. 

RELATED  WORK 

This  work  has  roots  in  the  ARCH  system  [Winston  1970],  and  the  FOX  system 
[Winston  1978],  both  identified  by  the  typical  things  involved  in  the  learning.  The  most 
direct  antecedent,  however,  is  the  MACBETH  system  [Winston  1980),  which 
concentrated  on  representation  and  matching  issues.  Others  who  have  worked  on 
matching  include  Michalski,  Hayes-Roth,  and  Vere.  See  Dietterich  and  Michalski  [1981] 
for  an  excellent  review.  For  analogy  itself,  Gentner’s  work  on  the  dimensions  of 
analogy  is  another  important  precedent  [1980]. 
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With  respect  to  context,  Marcus  has  addressed  questions  about  natural  rule  groups 
in  the  domain  of  English  parsing  [1980].  With  respect  to  constraint,  Davis  work  on 
knowledge-based  systems  suggested  that  the  regular  structure  of  if-then  rules  simplifies 
the  problem  of  knowledge  acquired  [1979].  Similarly,  Berwick  has  showed  how  to  learn 
the  rules  for  English  parsing  required  by  Marcus’s  parser,  arguing  that  a  highly 
constrained  rule  structure  is  a  prerequisite  for  such  learning  [1980]. 

In  addition,  debt  is  due  to  Schank  [1975],  Wilks  [1972],  and  many  linguists  who 
have  wondered  how  thinking  is  determined  by  experience.  William  A.  Martin  may  have 
had  the  deepest  insight  along  these  lines  when  he  remarked  in  a  lecture,  "You  can’t 
learn  anything  unless  you  almost  know  already." 
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APPENDIX  1:  NOTES 

This  appendix  contains  the  notes  referenced  in  the  body  of  this  paper. 

Note  A:  The  Implementation  is  based  on  FRL 

The  actual  implementation  was  done  using  a  version  of  FRL,  an  acronym  for  a 
LISP-based  Frame  Representation  Language,  developed  by  Bruce  Roberts  and  Ira 
Goldstein  [July  1977,  June  1977].  FRL  was  used  because  FRL  has  handy  mechanisms 
for  asserting  relations  and  attaching  supplementary  descriptions  to  them.  In  FRL  terms, 
an  actor-act-object  combination  is  expressed  as  a  frame,  a  slot  in  the  frame,  and  a  value 
in  the  slot.  A  supplementary  description  node  for  an  actor-act-object  combination  is 
expressed  in  the  form  of  a  so-called  comment  frame  attached  to  the  frame-slot-value 
combination. 

Note  B:  A  Sample  Read  by  the  Katz  Translator 

The  following  illustrates  the  greater  power  of  Katz’s  translator  relative  to  the  simple  one 
used  in  this  work: 

In  the  beginning  of  the  story  Duncan  was  a  king.  Macbeth  who  was  a  happy 
nobleman  married  Lady-Macbeth.  She  desired  that  he  become  king.  She 
persuaded  Macbeth  who  she  loved  to  murder  Duncan  because  she  was  greedy 
and  ambitious  and  also  because  she  was  cruel.  Soon  she  decided  to  kill 
herself  because  she  and  Macbeth  were  unhappy.  Macbeth’s  murder  of 
Duncan  caused  Macduff  who  was  a  loyal  nobleman  to  kill  Macbeth. 


Note  C:  Matcher  Performance  on  Shakespeare  Precis 

One  curious  sort  of  robust  behavior  was  observed  in  the  matcher:  it  gives  the  same 
relative  results  even  as  it  continues  to  be  debugged.  Similarity  scores  vary,  however,  as 
the  data  is  changed  and  newly  discovered  bugs  are  removed.  The  raw  scores,  the  total 
number  of  corresponding  things,  for  some  Shakespeare  comparisons  are  as  follows: 
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MA 

HA 

JU 

OT 

TA 

MAcbeth 

199 

HAmlet 

110 

Z35 

JUlius  Caesar 

71 

50 

154 

OThello 

40 

40 

56 

187 

TAming  of  The 

Shrew  20 

18 

21 

25 

111 

Similar  relative  ordering  is  observed  when  the  similarity  measure  is  taken  to  be  the 
normalized  scores,  the  number  of  corresponding  things  divided  by  the  larger  of  the 
number  of  corresponding  things  observed  when  matching  the  two  situations  involved 
against  themselves. 

MA 

HA 

JU 

OT 

TA 

MAcbeth 

100 

HAmlet 

55 

100 

JUlius  Caesar 

46 

32 

100 

OThello 

21 

21 

36 

100 

TAming  of  The 

Shrew  18 

15 

18 

22 

100 

Normalized  scores  seem  useful  because  a 
will  tend  to  have  a  better  normalized 

small  precedent  that  is  nearly  totally  matched 
score  than  a  large  precedent  that  has  many 

accidental  correspondences  arranged  in  a  piecemeal,  fragmented  way.  In  fact,  neither 
score  is  used  in  this  paper. 

Tables  showing  the  same  alternatives,  but  with  only  the  cause-determined 
important  relations  counted,  show  similar  relative  ordering. 

Note  D:  Several  Words  Imply  CAUSE  relations 

Many  people  have  attended  to  the  role  of  cause,  particularly  Schank  [1975]  and  Wilks 
(1972).  To  handle  cause  here,  the  following  conventions  were  honored,  based  on  the 
work  of  C?ivon  [1975], 

■  Acts  and  relations  can  cause  or  prevent  acts  and  relations.  The  inverses  of 
CAUSE  and  PREVENT  are  CAUSED-BY  and  PREVENTED-BY. 

■  People  can  persuade  and  dissuade.  Persuade  indicates  influence  and  cause.  A 
CAUSE  relation  is  therefore  generated  by  a  demon  whenever  PERSUADE  is  used. 
Dissuade  similarly  indicates  prevent.  Since  persuaders  and  dissuaders  normally 
intend  for  something  to  happen,  INTEND  relations  are  generated  too,  again  by 
demons.  Since  the  person  persuaded  or  dissuaded  retains  control  of  what  is 
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happening,  a  demon-placed  CONTROL  relation  so  indicates.  See  part  a  of 
figure  1 1  for  an  example  showing  what  happens  given  this: 

Lady-Macbeth  persuades  Macbeth  to  murder  Duncan. 


■  People  can  also  order  and  forbid.  For  the  moment  ORDER  and  FORBID  simply 
carry  demons  that  place  PERSUADE  and  DISSUADE  relations  and  trigger  their 
demons  in  turn. 


Figure  11:  The  meaning  of  persuade  and  force.  All  relations  are  placed  by  demons 
whenever  PERSUADE  AND  FORCE  are  used. 
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■  People  can  force.  Force  3  like  persuade,  except  that  the  person  forcing  has 
control  of  what  is  happening.  See  part  b  of  the  figure  for  an  example  showing  , 
what  happens  given  this  use  of  a  FORCE  relation: 

Lady-Macbeth  forces  Macbeth  to  murder  Duncan. 


These  conventions  differ  slightly  from  those  used  before  (Winston  1980)  in  that  only 
acts  and  relations  are  allowed  to  cause  or  prevent  acts  and  relations.  People  are  not. 

Note  E:  It  i$  Easy  to  add  a  Qualitative  Reasoning  Mechanism 

A  qualitative  reasoning  mechanism  was  implemented  and  survived  for  a  time.  It 
requires  two  kinds  of  calculations:  first,  a  way  to  combine  the  probability  of  all  rule 
antecedents  to  give  an  overall  probability  for  E,  the  evidence;  second,  a  way  to  vise  the 
current  probability  for  E  to  produce  an  influence  on  current  probability  for  the 
conclusion,  C;  and  third,  a  way  to  get  an  overall  probability  for  C,  given  that  several 
rules  argue  for  it. 

In  descriptions  of  inference  nets  (Duda  et  al.  1976],  extensive  use  is  made  of  the 
relation  between  probability  and  odds: 


Some  calculations  are  easier  in  probability  space,  while  others  are  easier  in  odds  space, 
just  as  in  linear  systems  theory,  some  calculations  are  easier  in  the  time  domain  and 
some  are  easier  in  the  frequency  domain. 

A&uming  independence,  theory  dictates  that  the  combined  probability  of 
antecedent  events  is  the  product  of  their  individual  probabilities: 

P(E)  =  P(E;)  P(E2)  .  .  .  P(E„) 

Theory  also  dictates  that  figure  1?  captures  the  relationship  among  the  informed 
probabilities  of  the  conclusion  C  and  the  evidence  E,  the  prior  probabilities  of  C  and  E, 
and  the  probabilities  of  C  given  that  E  is  certain  and  that  not  E  is  certain. 

Unfortunately,  when  questioning  experts  about  the  various  prior  and  boundary 
probabilities,  they  do  not  give  consistent  numbers  like  those  in  part  a  of  the  figure. 
Consequently,  Duda  et  al.  abandon  orthodox  theory  and  use  a  piecewise-linear 
relationship  to  link  C  to  E,  rather  that  a  strictly  linear  one.  Part  b  of  the  figure 
illustrates. 

Finally,  if  there  are  several  independent  rules  pointing  toward  C,  the  probability  of 
C,  computed  in  odds  space,  is  given  by  the  product  involving  the  odds  supplied  by  each 
rule: 


Patrick  H.  Winston 


-  37  - 


Notes 


Figure  12:  The  probability  of  a  conclusion  given  the  probability  of  the  evidence  for  it. 
The  probability  for  evidence  certain  to  be  absent  is  c.  The  probability  for  evidence 
certain  is  d.  The  prior  probabilities  of  the  conclusion  and  the  evidence  are  a  and  b  in 
both  graphs.  Part  a  illustrates  the  way  the  numbers  should  be  related  theoretically. 
Part  h  illustrates  the  sort  of  numbers  people  give,  when  asked,  and  what  Duda  et  al.  dr* 
with  them. 


0(C  given  evidence )  =  lambda /  .  .  .  lambda,,  OfC  a  priori) 


where 


To  transform  all  this  to  a  qualitative  theory,  it  is  necessary  to  have  tables  relating 
the  various  levels  of  certainty  rather  than  formulas.  For  example,  one  can  have  a  table 
for  combining  qualitative  odds  like  the  following: 


e 

ae 

u 

n 

1 

ac 

c 

n 

1 

ac 

c 

c 

c 

c 

c  =  certain 

u 

n 

1 

ac 

c 

c 

c 

ac  »  almost  certain 

ae 

u 

n 

1 

ac 

c 

c 

c  =  likely 

e 

ae 

u 

n 

1 

ac 

c 

n  =  neutral 

e 

e 

ae 

u 

n 

1 

ac 

ii  =  unlikely 

e 

e 

e 

ae 

u 

n 

1 

ae  =  almost  excluded 

e 

e 

e 

e 

ae 

u 

n 

e  *  excluded 

Alternatively, 

one  can 

use  ordinary  multiplication, 

together 

with 

a  function  from  names 
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to  numbers  and  an  inverse  function  from  intervals  to  names.  This  approach  was  taken, 
using  the  following,  which  gives  results  equivalent  to  the  table: 


Probability 

Odds 

Name 

.96 

27 

certain 

.90 

9 

almost  certain 

.75 

3 

likely 

.50 

1 

neutral 

.25 

.33 

unlikely 

.10 

.11 

almost  excluded 

.04 

.04 

excluded 

This  was  done  for  combining  qualitative  probabilities  using  multiplication  and  for 
relating  evidence  probabilities  to  conclusion  probabilities  using  a  piecewise  linear 
relation. 

The  result  was  a  system  that  seemed  human-like  in  one  way  and  not  in  another. 
Because  of  the  quantization,  it  was  sensitive  to  the  order  in  which  supporting  evidence 
for  a  fact  was  given,  with  the  most  recent  evidence  dominating  older  evidence,  as  with 
people.  On  the  other  hand,  the  overall  certainty  reported  for  a  chain  of  more  than  one 
or  two  causes  seemed  lower  than  intuition  led  me  to  expect. 

Consequently  the  implemented  qualitative  reasoning  program  did  not  seem 
sufficiently  human-like  or  otherwise  illuminating  to  warrant  further  work  and  it  has 
been  put  aside  for  the  moment. 
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APPENDIX  2:  THE  EXPERIMENTS 

This  appendix  contains  a  trace  of  a  set  of  experiments,  some  of  which  are  described  in 
the  body  of  this  paper. 

In  MA  there  is  Macbeth  Lady-macbeth  Duncan  and  Macduff.  Macbeth  is  an 
evil  noble.  Lady  macbeth  is  a  greedy  ambitious  woman.  Duncan  is  a 
king.  Macduff  is  a  loyal  noble.  Macbeth  is  evil  because  Macbeth  is 
weak  and  because  Macbeth  married  Lady  macbeth  and  because  Lady-macbeth 
is  greedy.  Lady  macbeth  persuades  Macbeth  to  want  to  be  king. 

Lady-macbeth  influenced  Macbeth  because  Lady  macbeth  is  greedy  and 
because  Macbeth  married  Lady-macbeth.  Macbeth  murders  Duncan  with 
Lady-Macbeth  using  a  knife  because  Macbeth  wants  to  be  king  and 
because  Macbeth  is  evil.  Lady-macbeth  kills  Lady  macbeth.  Macduff  is 
angry.  Macduff  kills  Macbeth  because  Macbeth  murdered  Duncan  and 
because  Macduff  is  loyal. 

In  EXERCISE-M  A- 1  there  is  a  man  and  a  woman.  The  man  married  the 
woman.  The  man  is  weak  and  the  woman  is  greedy.  Show  that  the  man  in 
EXERCISE-M  A-l  may  be  evil. 

!  am  trying  to  show  [  MAN-1  HAS-QUALITY  EVIL  ] 

Supply  t  «  true,  ?  *»  don’t  know,  I  «  look,  or  a  precedent: 

>  ma 

Matching  MA  against  EXERClSE-MA-1 


21.  values  match  with  (84.  and  24.  possible. 

Normalized  score  is  87.  % 

Match  is  decisive  -  10.  better  than  next  best. 

I  note  that  [  WOMAN  !  HAS-QUALITY  GREEDY  ]  for  use  with  MA 
I  note  that  [  MAN-1  MARRY  WOMAN-1  ]  for  use  with  MA 
I  note  that  [  MAN-1  HAS-QUALITY  WEAK  ]  for  use  with  MA 
The  evidence  from  M A  indicates  [  MAN-1  HAS-QUALITY  EVIL  ] 

Rule  RULE-1  is  derived  from  MA  and  looks  like  this; 

Rule 

RULE  1 
if 

[  MAN-4  HAS-QUALITY  WEAK  ] 

[  MAN-4  MARRY  WOMAN-2  ) 

(  WOMAN-2  HAS-QUALITY  CfREEDY  ] 

then 

[  MAN  4  HAS-QUALITY  EVIL  ] 

case 

MA 

Should  I  index  it? 

>  > 

Noting  that  (  MAN  HAS  QUALITY  EVIL  ]  in  MAN  suggests  RULE-1  for  THEN 

In  EXERCISE-M A-2  there  is  a  noble  a  lady  a  prince  and  a  king.  The 
noble  married  the  lady.  The  noble  is  evil  and  the  lady  is  greedy  and 
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the  piince  is  loyal.  Show  that  the  prince  in  EXERCISE-MA-2  may  kill 
the  noble. 

1  am  trying  to  show  [  PRINCE  I  KILL  NOBLE-I  ] 

Supply  t  =  true, 1  =  don’t  know,  I  =  look,  or  a  precedent: 

>  ma 

Matching  EXERCISE-MA-2  against  MA 
. 50. 


46.  values  match  with  53.  and  184.  possible. 

Normalized  score  is  86.  r'c 

Match  is  decisive  --  13.  better  than  next  best. 

1  note  that  [  PRINCE-I  HAS -QUALITY  LOYAL  ]  for  use  with  MA 
I  note  that  [  NOBLE  I  HAS-QUALITY  EVIL  ]  for  use  with  MA 
I  note  that  (  NOBLE-1  MARRY  LADY-1  ]  for  use  with  MA 
I  note  that  [  LADY- 1  HAS-QUALITY  GREEDY  ]  for  use  with  MA 
The  evidence  from  MA  indicates  [  PRINCE-I  KILL  NOBLE-I  ] 

Rule  RULE-2  is  derived  from  MA  and  looks  like  this: 

Rule 

RULE  2 
if 

(  LADY-6  HAS  QUALITY  GREEDY  ] 

[  NOBLE-8  MARRY  LADY-6  ] 

[  NOBLE  8  HAS  QUALITY  EVIL  ] 

[  PRINCE  4  HAS-QUALITY  LOYAL  ] 

then 

[  PRINCE  4  KILL  NOBLE  8  ] 

case 

MA 

Should  I  index  it? 

>  y 

Noting  that  [  PRINCE  KILL  NOBLE  ]  in  PRINCE  suggests  RULE-2  for  THEN 

In  EXERCISE-M  A-3  there  is  a  noble  a  lady  and  a  prince.  The  noble 
married  the  lady.  The  noble  is  evil  and  the  lady  is  greedy  and  the 
prince  is  loyal.  Verify  that  the  prince  in  EXERCISE-MA-3  may  kill  the 
noble. 

I  am  trying  to  show  [  PRINCE-2  KILL  NOBLE-2  ] 

Supply  t  «  true, 1  -  don't  know,  I  *>  look,  or  a  precedent: 

>  I 

For  [  PRINCE  2  KILL  NOBLE-2  ] 

I  use  indexes  in  PRINCE  2  PRINCE  MAN  NOBLE  PERSON 

and  I  have  discovered:  RULE-2 

Matching  EXERCISE  MA  3  against  RULE-2 


44.  values  match  with  48.  and  75.  possible. 

Normalized  score  is  91.  r'r 

Win  by  default  -  only  one  possibility. 

I  note  that  (  LADY-2  HAS  QUALITY  GREEDY  ]  for  use  with  RULE-2 
I  note  that  [  NOBLE-2  MARRY  LADY-2  ]  for  use  with  RULE-2 
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I  note  that  [  NOBLE-2  HAS  QUALITY  EVIL  ]  for  use  with  RULE-2 
I  note  that  [  PRINCE-2  HAS  QUALITY  LOYAL  ]  for  use  with  RULE-2 
The  evidence  from  RULE  2  indicates  [  PRINCE-2  KILL  NOBLE-2  ] 

Challenge  that  the  prince  in  EXERC1SE-MA  3  may  kill  the  noble. 

The  rule  used  for  [  PRINCE-2  KILL  NOBLE-2  ]  is  RULE-2 
The  precedent  for  RULE-2  is  MA 
Matching  MA  against  EXERCISE-MA  3 


42.  values  match  with  184.  and  49.  possible. 

Normalized  score  is  85.  Cr 

Match  is  decisive  ~  10.  better  than  next  best. 

I  note  that  [  PRINCE-2  HAS  QUALITY  LOYAL  ]  for  use  with  MA 
Beware’  Lise  of  match  required  creating  KING-7  for  DUNCAN 
I  note  that  [  NOBLE  2  HAS  QUALITY  EVIL  ]  for  use  with  MA 
I  note  that  [  NOBLE-2  MARRY  LADY-2  )  for  use  with  MA 
I  note  that  [  LADY  2  HAS  QUALITY  GREEDY  ]  for  use  with  MA 
The  evidence  from  M  A  indicates  (  PRINCE  2  KILL  NOBLE-2  ] 

In  EXERCISE  MA-4  there  is  a  man.  The  man  is  evil.  The  man  wants  to 
be  king.  In  exercise-ma-4  there  is  a  king.  Show  that  the  man  in 
EXERCISE -MA  4  may  murder  the  king. 

I  am  trying  to  show  [  MAN  2  MURDER  KINCi-2  ] 

Supply  t  »  true,  ?  =  don’t  know,  1  **  look,  or  a  precedent: 

>  ma 

Matching  MA  against  EXERCISE-MA-4 

43.  values  match  with  184.  and  46.  possible. 

Normalized  score  is  93.  *7c 

Match  is  decisive  -21.  better  than  next  best. 

I  note  that  [  MAN-2  HAS-QUALITY  EVIL  ]  for  use  with  MA 
I  note  that  [  MAN-2  WANT  [  MAN-2  AKO  KING  ]  ]  for  use  with  MA 
The  evidence  from  MA  indicates  [  MAN-2  MURDER  KING-2  ] 

Rule  RULE-3  is  derived  from  MA  and  looks  like  this: 

Rule 

RULE  3 
if 

[  MAN-5  WANT  [  MAN-5  AKO  KING  ]  ] 

(  MAN-5  HAS-QUALITY  EVIL  ] 

then 

[  MAN-5  MURDER  KING-8  ] 

case 

MA 

Should  I  index  it? 

>  y 

Noting  that  [  MAN  MURDER  KING  ]  in  MAN  suggests  RULE-3  for  THEN 

In  EXERCISE-MA-5  there  is  a  noble  and  a  lady.  The  lady  is  greedy  and 
the  noble  is  weak.  The  noble  wants  to  be  king.  In  exercise-ma-5 
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there  is  a  king.  Show  that  the  noble  in  EXERCISE  MA-5  may  murder  the 
king. 

1  am  trying  to  show  (  NOBLE  3  MURDER  KING-3  ] 

Supply  t  =*  true,  ?  -  don't  know,  I  -  look,  or  a  precedent: 

>  I 

For  [  NOBLE  3  MURDER  KING-3  ] 

I  use  indexes  in  NOBLE  3  NOBLE  KING  MAN  RULER  PERSON 

and  1  have  discovered:  ’RL1LE-3 

Matching  EXERCISE  MA-5  against  RULE-3 


39.  values  match  with  55.  and  52.  possible. 

Normalized  score  is  75.  CJ> 

Match  is  decisive  -  29.  better  than  next  best. 

I  note  that  (  NOBLE-3  WANT  (  NOBLE-3  AKO  KING  ]  ]  for  use  with  RULE-3 
To  use  RULE-3  I  need  to  know  if  (  NOBLE-3  HAS-QUALITY  EVIL  ] 

I  am  trying  to  show  [  NOBLE  3  HAS-QUALITY  EVIL  ] 

Supply  t  »  true,  ?  =  don't  know,  I  *»  look,  or  a  precedent: 

>  1 

For  [  NOBLE  3  HAS  QUALITY  EVIL  ] 

1  use  indexes  in  NOBLE  3  NOBLE  KING  MAN  RULER  PERSON 

and  I  have  discovered:  RULE-1 

Matching  EXERCISE  MA-5  against  RULE-1 


12.  values  match  with  55.  and  45.  possible. 

Normalized  score  is  26.  % 

Match  is  decisive  --  4.  better  than  next  best. 

1  note  that  [  NOBLE-3  HAS  QUALITY  WEAK  ]  for  use  with  RULE-1 
To  use  RULE-1  1  need  to  know  if  [  NOBLE-3  MARRY  LADY-3  J 
I  am  trying  to  show  [  NOBLE-3  MARRY  LADY-3  ] 

Supply  t  "  true.  ?  •  don't  know,  I  »  look,  or  a  precedent: 

>  i 

1  note  that  [  LADY-3  HAS-QUALITY  GREEDY  )  for  use  with  RULE-1 
The  evidence  from  RULE-1  indicates  [  NOBLE-3  HAS-QUALITY  EVIL  ] 

The  evidence  from  RULE-3  indicates  l  NOBLE-3  MURDER  KING-3  ) 

Rule  RULE  4  is  derived  from  RULE-3  RULE-1  and  looks  like  this: 

Rule 

RULE  4 
if 

(  L  ADY-7  HAS  QUALITY  GREEDY  ] 

(  NOBLE  9  MARRY  LADY-7  ] 

[  NOBLE  9  HAS  QUALITY  WEAK  ) 

(  NOBLE  9  WANT  [  NOBLE-9  AKO  KING  ] ) 

then 

(  NOBLE  9  MURDER  K1NC.-9  ] 

case 

RULE  3  RULE-1 
Should  1  index  it'1 

>  y 

Noting  that  (  NOBLE  MURDER  KING  ]  in  NOBLE  suggests  RULE-4  for  THEN 
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In  EXERCISE-MA-6  there  is  a  noble  and  a  princess.  The  princess  is 
greedy.  Show  that  the  noble  in  EXERCISE-MA-6  may  want  to  be  king. 

I  am  trying  to  show  [  NOBLE-4  WANT  [  NOBLE-4  AKO  KING  ] ) 
Supply  t  *  true.  ?  *  don’t  know,  l  =  look,  or  a  precedent: 

>  ma 

Matching  MA  against  EXERCISE-MA-6 


15.  values  match  with  184.  and  18.  possible. 

Normalized  score  is  83.  c/r 

Match  is  decisive  -  2.  better  than  next  best. 

Beware?  Lise  of  match  required  creating  KING-10  for  DUNCAN 
To  use  MA  I  need  to  know  if  [  NOBLE-4  MARRY  PRINCESS-1  ] 

I  am  trying  to  show  [  NOBLE-4  MARRY  PRINCESS-1  ] 

Supply  t  «  true,  ?  -  don’t  know,  I  *=  look,  or  a  precedent: 

>  t 

I  note  that  [  PRINCESS-1  HAS-QUALITY  GREEDY  ]  for  use  with  MA 
The  evidence  from  M A  indicates  [  NOBLE-4  WANT  [  NOBLE-4  AKO  KING  ]  ] 
Rule  RULE-5  is  derived  from  MA  and  looks  like  this: 

Rule 

RULE  5 

if 

[  PRINCESS-2  HAS-QUALITY  GREEDY  ] 

[  NOBLE- 10  MARRY  PRINCESS-2  ] 

then 

[  NOBLE-IO  WANT  [  NOBLE-IO  AKO  KING  ]  ] 

case 

MA 

Should  I  index  it? 

>  y  . 

Noting  thSt  [NOBLE  WANT  AKO  ]  in  NOBLE  suggests  RULE-5  for  THEN 

In  EXERCISE-MA-7  there  is  a  noble  a  lady  and  a  king.  The  lady  is 
greedy  and  the  noble  is  weak.  Show  that  the  noble  in  EXERCISE-MA-7 
may  murder  the  king. 

I  am  trying  to  show  [  NOBLE-5  MURDER  KING-4  ) 

Supply  t  »  true,  ?  *  don’t  know,  I  «  look,  or  a  precedent: 

>  I 

For  [  NOBLE-5  MURDER  KING-4  ] 

I  use  indexes  in  NOBLE  5  NOBLE  MAN  PERSON 
and  I  have  discovered:  RULE-3  RULE-4 
Matching  EXERCISE-MA-7  against  RULE-3 


33.  values  match  with  49.  and  52.  possible. 

Normalized  score  is  67.  % 

Match  is  decisive  -  23.  better  than  next  best. 

To  use  RULE-3  I  need  to  know  if  [  NOBLE-5  WANT  [  NOBLE-5  AKO  KING  ]  ] 
I  am  trying  to  show  [  NOBLE-5  WANT  (  NOBLE-5  AKO  KING  ]  ] 

Supply  t  -  true,  ?  *  don't  know,  I  -  look,  or  a  precedent: 

>  I 
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For  (  NOBLE  S  WANT  [  NOBLE  S  AKO  KING  ]  J 

I  um?  indexes  in  NOBLE  5  NOBLE  KING  MAN  RULER  PERSON 

and  I  have  discovered:  RULE-5 

Matching  EX ERCISE-MA-7  against  RULE-5 


14.  values  match  with  55.  and  25.  possible. 

Normalized  score  is  56.  % 

Match  is  decisive  -  4.  better  than  next  best. 

I  note  that  [  LADY-4  HAS  QUALITY  GREEDY  ]  for  use  with  RULE-5 
To  use  RULE-5  I  need  to  know  if  [  NOBLE  5  MARRY  LADY-4  ] 

1  am  trying  to  show  [  NOBLE-5  MARRY  LADY-4  ] 

Supply  t  =  true,  0  =  don’t  know,  I  «  look,  or  a  precedent: 

>  t 

The  evidence  from  RULE-5  indicates  [  NOBLE-5  WANT  (  NOBLE-5  AKO  KING  J 

1 

To  use  RULE-3  I  need  to  know  if  [  NOBLE-5  HAS-QUALITY  EVIL  ] 

I  am  trying  to  show  [  NOBLE-5  HAS-QUALITY  EVIL  ] 

Supply  t  =  true,  ?  -  don’t  know,  I  -  look,  or  a  precedent: 

>  I 

For  [  NOBLE  5  HAS  QUALITY  EVIL  ) 

I  use  indexes  in  NOBLE-5  NOBLE  KING  MAN  RULER  PERSON 

and  I  have  discovered:  RlILE-1 

Matching  EXERCISE-MA-7  against  RULE-1 


17.  values  match  with  60.  and  45.  possible. 

Normalized  score  is  37.  % 

Match  is  decisive  -  9.  better  than  next  best. 

I  note  that  [  NOBLE  5  HAS  QUALITY  WEAK  ]  for  use  with  RULE-! 

I  note  that  [  NOBLE-5  MARRY  LADY-4  ]  for  use  with  RULE-i 
I  note  that  [  LADY  4  HAS  QUALITY  GREEDY  ]  for  use  with  RULE-1 
The  evidence  from  RULE-1  indicates  [  NOBLE-5  HAS-QUALITY  EVIL] 

The  evidence  from  RULE-3  indicates  [  NOBLE-5  MURDER  KIN ^-4  ] 

Rule  RULE  6  is  derived  from  RULE-3  RULE-1  RULE-5 
and  looks  like  this: 

Rule 

RULE  6 
if 

[  LADY  8  HAS  QUALITY  GREEDY  ] 

(  NOBLE  II  MARRY  LADY-8  ] 
l  NOBLE  II  HAS  QUALITY  WEAK  ] 

ihen 

[  NOBLE  II  MURDER  KING  II  ] 

case 

RULE  3  RULE  I  RULE  5 
Should  I  index  it0 
>  y  ’ 

Noting  that  [  NOBLE  MURDER  KING  ]  in  NOBLE  suggests  RULE-6  for  THEN 


In  EXERCISE  MA  8  there  is  a  noble  a  lady  a  prince  and  a  king.  The 
noble  is  evil.  The  lady  is  greedy.  The  noble  married  the  lady.  Show 
that  the  noble  in  EXERCISE-MA-8  may  be  dead. 
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In  EXERCISE-MA-9  there  is  a  man  a  noble  and  a  king.  The  man  is  loyal. 
The  man  loves  the  king.  The  noble  murders  the  king.  Show  that  the 
man  in  EXERCISE-M A-9  may  kill  the  noble. 

I  am  trying  to  show  [  NOBLE-6  HAS-QUALITY  DEAD  ] 

Supply  t  -  true,  ?  -  don't  know,  I  *  look,  or  a  precedent: 

>  ma 

Matching  EXERCISE-M A-8  against  MA 
. 50. 


29.  values  match  with  36.  and  184.  possible. 

Normalized  score  is  80.  % 

Match  is  decisive  -  3.  better  than  next  best. 

To  use  MA  1  need  to  know  if  [  PRINCE-3  HAS-QUAL1TY  LOYAL  ] 

I  am  trying  to  show  [  PRINCE-3  HAS-QUALITY  LOYAL  ] 

Supply  t  *  true,  ?  =  don’t  know,  I  »  look,  or  a  precedent: 

>  t 

I  note  that  [  NOBLE-6  HAS-QUALITY  EVIL  }  for  use  with  MA 
I  note  that  [  NOBLE-6  MARRY  LADY-5  ]  for  use  with  MA 
I  note  that  [  LADY-5  HAS-QUALITY  GREEDY  ]  for  use  with  MA 
The  evidence  from  MA  indicates  [  NOBLE-6  HAS-QUALITY  DEAD  ] 

Rule  RULE-7  is  derived  from  MA  and  looks  like  this: 

Rule 

RULE  7 
if 

t  LADY-9  HAS-QUALITY  GREEDY  ] 

[  NOBLE-12  MARRY  LADY-9  ] 

(  NOBLE-12  HAS-QUALITY  EVIL  ] 

[  PRINCE-5  HAS-QUALITY  LOYAL  ] 

then 

{  NOBLE-12  HAS-QUALITY  DEAD  ] 

case 

MA 

Should  I  index  it? 

>  y 

Noting  that  [  NOBLE  HAS  QUALITY  DEAD  ]  in  NOBLE  suggests  RULE-7  for 
THEN 

(Eval  9a) 

I  am  trying  to  show  [  MAN-3  KILL  NOBLE-7  ] 

Supply  t  «  true,  ?  =  don’t  know,  I  »  look,  or  a  precedent: 

>  ma 

Matching  MA  against  EXERCISE-MA-9 


57.  values  match  with  184.  and  65.  possible. 

Normalized  score  is  87.  Cfr 

Match  is  decisive  *•  17,  better  than  next  best. 

I  note  that  [  MAN-3  HAS-QUALITY  LOYAL  )  for  use  with  MA 
I  note  that  [  NOBLE-7  MURDER  KING-6  )  for  use  with  MA 
The  evidence  from  MA  indicates  {  MAN-3  KILL  NOBLE-7  ) 
Rule  RULE-8  is  derived  from  MA  and  looks  like  this: 


f 
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RULE-8 

if 

[  NOBLE-13  MURDER  KING-12  J 
[  MAN  6  HAS  QUALITY  LOYAL  ] 

then 

I  MAN-6  KILL  NOBLE-13  ] 

case 

MA 

Should  I  index  it? 

>  y 

Noting  that  [  MAN  KILL  NOBLE  ]  in  MAN  suggests  RULE-8  for  THEN 

In  \V\V  there  are  Germany  Hitler  Poland  and  England.  Germany  is  an 
misled  country.  Hitler  is  a  greedy  ambitious  dictator.  Poland  owns 
Poland.  England  is  a  loyal  country.  Germany  is  misled  because 
Germany  is  weak  and  because  Hitler  ruled  Germany  and  because  Hitler  is 
greedy.  Hitler  persuades  Germany  to  want  to  own  Poland.  Hitler 
influenced  Germany  because  Hitler  is  greedy  and  because  Hitler  ruled 
Germany.  Germany  attacks  Poland  with  Hitler  using  some  tanks  because 
Germany  wants  to  own  Poland  and  because  Germany  is  misled.  Poland  is 
a  victim  country.  England  is  angry.  England  attacks  Germany  because 
Germany  attacked  Poland  and  because  England  is  loyal.  Germany  is 
defeated  because  England  attacks  Germany.  Hitler  kills  Hitler. 

In  EXERCISE  WW-I  there  are  a  country  and  a  dictator.  The  dictator 
ruled  the  country.  The  country  is  weak  and  the  dictator  is  greedy. 

Show  that  the  country  in  EXERCISE- WW-1  may  be  misled. 

I  am  trying  to  show  [  COUNTRY  1  HAS-QUALITY  MISLED  ] 

Supply  t  =  true,  ?  *  don’t  know,  1  *  look,  or  a  precedent: 

>  ww 

Matching  WW  against  EXERCISE-WW  I 


21.  values  match  with  150,  and  24.  possible. 

Normalized  score  is  87,  % 

Match  is  decisive  -  10/better  than  next  best, 

I  note  that  [  DICTATOR  I  HAS  QUALITY  GREEDY  ]  for  use  with  WW 
I  note  that  (  DICTATOR  !  RULE  COUNTRY- 1  ]  for  use  with  WW 
1  note  that  [  COUNTRY  !  HAS  QUALITY  WEAK  ]  for  use  with  WW 
The  evidence  from  WW  indicates  (  COUNTRY  I  HAS-QUALITY  MISLED  ] 
Rule  RULE  15  is  derived  from  WW  and  looks  like  this: 

Rule 

RULE  15 
if 

[  COUNTRY-7  HAS  QUALITY  WEAK  ) 

[  DICTATOR-8  RULE  COUNTRY-7  ] 

[  DICTATOR-8  HAS  QUALITY  GREEDY  ) 

then 

[  COUNTRY-7  HAS  QUALITY  MISLED  ] 


Experiments 


case 


1 


I 
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ww 

Should  I  index  it? 

>  y 

Noting  that  [  COUNTRY  HAS  QUALITY  MISLED  ]  in  COUNTRY  suggests  RULE-15 
for  THEN 

In  EXERCISE-WW-2  there  are  an  aggressor-country  a  dictator  a  country 
and  a  victim-country.  The  dictator  ruled  the  aggressor-country.  The 
aggressor-country  is  misled  and  the  dictator  is  greedy  and  the  country 
is  loyal.  Show  that  the  country  in  EXERCISE-WW-2  may  attack  the 
aggressor-country. 

I  am  trying  to  show  [  COUNTRY  2  ATTACK  AGGRESSOR-COUNTRY- 1  ] 

Supply  t  =  true,  ?  =  don’t  know,  I  «  look,  or  a  precedent: 

>  ww 

Matching  EXERCISE-WW.2  against  WW 


29.  values  match  with  35.  and  150.  possible. 

Normalized  score  is  82.  Cr 

Match  is  decisive  -  10.  better  than  next  best. 

I  note  that  [  COUNTRY-2  HAS  QUALITY  LOYAL  ]  for  use  with  WW 
I  note  that  [  AGGRESSOR-COUNTRY- 1  HAS-QUALITY  MISLED  ]  for  use  with  WW 
I  note  that  [  DICTATOR-2  RULE  AGGRESSOR-COUNTRY- 1  ]  for  use  with  WW 
l  note  that  [  DICTATOR-2  HAS  QUALITY  GREEDY  ]  for  use  with  WW 
The  evidence  from  WW  indicates  [  COUNTRY-2  ATTACK  AGGRESSOR-COUNTRY- 1 
) 

Rule  RULE-17  is  derived  from  WW  and  looks  like  this: 

\ ,  Rule 

!;  RULE  17 

[  DICTATOR  <)  HAS-QUALITY  GREEDY  ] 

I  [  DICTATOR-*)  RULE  AGGRESSOR  COUNTRY-8  ] 

!  t  AGGRESSOR-COUNTRY-8  HAS-QUALITY  MISLED  ] 

j  [  COUNTRY-8  HAS  QUALITY  LOYAL  ] 

then 

[  COUNTRY-8  ATTACK  AGGRESSOR-COUNTRY-8  ] 

case 

WW 

Should  I  index  it? 

>  y 

Noting  that  [  COUNTRY  ATTACK  AGGRESSOR -COUNTRY  ]  in  COUNTRY  suggests 
RULE  17  for  THEN 

In  EXERCISE-WW-4  there  are  a  country  and  a  victim-country.  The 
country  is  misled.  The  country  wants  to  own  the  victim-country.  Show 
that  the  country  in  EXERCISE  WW  4  may  attack  the  victim-country. 

I  am  trying  to  show  (  COUNTRY  4  ATTACK  VICTIM  COUNTRY-2  ] 

Supply  t  -  true,  ?  -  don't  know,  I  »  look,  or  a  precedent: 

>  ww 
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Matching  WW  against  EXERCISE-WW-4 


16.  values  match  with  150.  and  1 9.  possible. 

Normalized  score  is  84.  Cl- 

Match  is  decisive  -  10.  better  than  next  best. 

I  note  that  [  COUNTRY-4  HAS  QUALITY  MISLED  ]  for  use  with  WW 
1  note  that  (  COUNTRY  4  WANT  [  COUNTRY-4  OWN  VICTIM-COUNTRY-2  ]  1 
for  use  with  WW 

The  evidence  from  WW  indicates  [  COUNTRY  4  ATTACK  VICT1M-COUNTRY-2  ] 

Rule  RLILE-19  is  derived  from  WW  and  looks  like  this: 

Rule 

RULE  19 
if 

[  COUNTRY  9  WANT  (  COUNTRY-9  OWN  VICTIM-COUNTRY-8  ]  J 
[  COUNTRY  9  HAS-QUALITY  MISLED  ] 

then 

[  COUNTRY-9  ATTACK  VICTIM-COUNTRY-8  ] 

case 

WW 

Should  1  index  it? 

>  y 

Noting  that  [  COUNTRY  ATTACK  VICTIM-COUNTRY  ]  in  COUNTRY  suggests 
RULE-19  for  THEN 

In  EXERCISE-WW-5  there  are  an  aggressor-country  a  dictator  and  a 
victim-country.  The  dictator  is  greedy  and  the  aggressor-country  is 
weak.  The  aggressor-country  wants  to  own  the  victim-country.  Show 
that  the  aggressor-country  in  EXERCISE-WW-5  may  attack  the 
victim-country. 

I  am  trying  to  show  {  AGGRESSOR -COUNTRY-3  ATTACK  VICTIM-COUNTRY-3  ] 

Supply  t  =  true,  ?  =  don’t  know,  1  =  look,  or  a  precedent: 

>  I 

For  [  AGGRESSOR  COUNTRY  3  ATTACK  VICTIM-COUNTRY-3  ] 

I  use  indexes  in  AC.GRESSOR-COUNTRY-3  AGGRESSOR-COUNTRY  COUNTRY  THING 

and  I  have  discovered:  RULE-19 

Matching  EXERCISE-WW-5  against  RULE-19 


12.  values  match  with  28.  and  26.  possible. 

Normalized  score  is  46.  Cr 

Match  is  decisive  -  10.  better  than  next  best. 

I  note  that  [  AGG R ESSOR  -COUNTR Y-3  WANT  (  AGGRESSOR -COUNTRY-3  OWN 
VICTIM  COUNTRY  3  ] )  for  use  with  RULE-19 

To  use  RULE-19  1  need  to  know  if  [  AGGRESSOR-COUNTRY-3  HAS-QUALITY 
MISLED  ] 

I  am  trying  to  show  [  AGGRESSOR-COUNTRY-3  HAS-QUALITY  MISLED  ] 

Supply  t  -  true.  ?  -  don't  know,  I  -  look,  or  a  precedent: 

>  I 

For  [  AGGRESSOR  COUNTRY-3  HAS  QUALITY  MISLED  ] 

I  use  indexes  in  AGGRESSOR  COUNTRY-3  AGGRESSOR -COUNTRY  COUNTRY  THING 
and  I  have  discovered:  RULE- 1 5 
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Matching  EXERCISE  WW  5  against  RULE-15 


13.  values  match  with  28.  and  45.  possible. 

Normalized  score  is  46.  G> 

Match  is  decisive  --  6.  better  than  next  best. 

I  note  that  [  AGGRESSOR  COUNTRY  3  HAS  QUALITY  WEAK  ]  for  use  with 
RULE  15 

To  use  RULE  15  I  need  to  know  if  [  DICTATOR-4  RULE  AGGRESSOR -COUNTRY-3 

1 

I  am  trying  to  show  [  DICTATOR-4  RULE  AGGRESSOR  COUNTRY-3  ] 

Supply  t  =  true,  ?  -  don't  know,  I  =  look,  or  a  precedent: 

>  t 

I  note  that  [  DICTATOR -4  HAS  QUALITY  GREEDY  ]  for  use  with  RULE-15 
The  evidence  from  RULE  15  indicates  [  AGC.RESSOR-COUNTRY-3  HAS-QUALITY 
MISLED  ] 

The  evidence  from  RULE-19  indicates  [  AGGRESSOR-COUNTRY-3  ATTACK 
VICTIM  COUNTRY-3  ] 

Rule  RIJLE  2 1  is  derived  from  RULE-19  RULE-15  and  looks  like  this: 

Rule 

RULE-21 

if 

[  DICTATOR-10  HAS  QUALITY  GREEDY  ] 

[  DICTATOR  10  RULE  AGGRESSOR  COUNTRY-9  ] 

[  AGGRESSOR-COUNTRY-9  HAS-QUALITY  WEAK  ] 

[  AGGRESSOR-COUNTRY-9  WANT  [  AGGRESSOR-COUNTRY-9  OWN 
VICTIM-COUNTRY-9  ) ) 
then 

[  AGGRESSOR  COUNTRY  9  ATTACK  VICTIM-COUNTRY-9  ] 

case 

RULE  19  RULE-15 
Should  I  index  it? 

>  y 

Noting  that  [  AGGRESSOR  COUNTRY  ATTACK  VICTIM-COUNTRY  ]  in 
AGGRESSOR  COUNTRY  suggests  RULE-21  for  THEN 

In  EXERCISE-WW-6  there  are  an  aggressor-country  and  a  dictator  and  a 
victim-country.  The  dictator  is  greedy.  The  dictator  rules  the 
aggressor-country.  Show  that  the  aggressor-country  in  EXERCISE-WW-6 
may  want  to  own  the  victim-country. 

I  am  trying  to  show  (  AGGRESSOR-COUNTRY-4  WANT  [  AGGRESSOR-COUNTRY-4 
OWN  VICTIM-COUNTRY-4  ]  ] 

Supply  t  -  true,  ?  -  don’t  know,  I  =  look,  or  a  precedent: 

>  ww 

Matching  WW  against  EXERCISE-WW-6 


1 9.  values  match  with  150.  and  23.  possible. 

Normalized  score  is  82.  G> 

Match  is  decisive  --  6.  better  than  next  best. 

I  note  that  [  DICTATOR  5  RULE  AGGRESSOR-COUNTRY-4  ]  for  use  with  WW 
I  note  that  (  DICTATOR  S  HAS  QUALITY  GREEDY  ]  for  use  with  WW 
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The  evidence  from  WVV  indicates  [  AC.GRESSOR-COUNTRY-4  WANT  [ 

AGGRESSOR  COUNTRY-4  OWN  VICTIM  COUNTRY-4  ]  ] 

Rule  RUL  E  23  is  derived  from  WW  and  looks  like  this: 

Rule 

RULE  23 
if 

[  DICTATOR  1 1  HAS-QUALITY  GREEDY  ] 

[  DICTATOR  11  RULE  AGGRESSOR  COUNTRY-10  ] 

then 

[  AGGRESSOR  COUNTRY-10  WANT  [  AGGRESSOR-COUNTRY-IO  OWN 
VICTIM  COUNTRY-10]] 
case 

WW 

Should  1  index  it? 

>  y 

Noting  that  [  AGGRESSOR  COUNTRY  WANT  OWN  ]  in  AGGRESSOR-COUNTR Y 
suggests  RULE-23  for  THEN 

In  EXERCISE-WW-7  there  are  an  aggressor-country  a  dictator  and  a 
victim  country.  The  dictator  is  greedy  and  the  aggressor-country  is 
weak.  Show  that  the  aggressor-country  in  EXERCISE-WW-7  may  attack  the 
victim-country. 

I  am  trying  to  show  [  AGGRESSOR-COUNTRY-5  ATTACK  VICTIM-COUNTRY-5  ] 

Supply  t  =  true,  ?  =  don’t  know,  I  =  look,  or  a  precedent: 

>  I 

For  [  AGGRESSOR  COUNTRY-5  ATTACK  VICTIM-COUNTRY-5  ] 

I  use  indexes  in  AGGRESSOR-COUNTRY-5  AGGRESSOR-COUNTRY  COUNTRY  THING 
and  I  har  e  discovered:  RULE-19  RULE-21 
Matching  EXERCISE  WW  7  against  RULE-19 


7.  values  match  with  23.  and  26.  possible. 

Normalized  score  is  30.  % 

Match  is  decisive  -  5.  better  than  next  best. 

To  use  RIILE-I9  1  need  to  know  if  [  AGGRESSOR-COUNTR \'-5  WANT[ 

AGGRESSOR  COUNTRY  5  OWN  VICTIM-COUNTRY-5  ]  ] 

I  am  trying  to  show  [  AGGRESSOR-COUNTRY-5  WANT  [  AGC.RESSOR-COUNTRY-5 
OWN  VICTIM  COUNTRY-5  ]] 

Supply  t  =  true,  7  =  don’t  know,  I  =  look,  or  a  precedent: 

>  I 

For  [  AGGRESSOR  COUNTRY  5  WANT  [  AGGRESSOR-COUNTRY-5  OWN 
VICTIM  COUNTRY  5  J  ] 

I  use  indexes  in  AGGRESSOR  COUNTRY-5  AGGRESSOR-COUNTRY  COUNTRY  THING 

and  I  have  discovered:  RllLE-23 

Matching  EXERCISE-WW  7  against  RULE-23 


15.  values  match  with  28.  and  25.  possible. 

Normalized  score  is  60.  CJ> 

Win  by  default  --  only  one  possibility. 

I  note  that  (  DICTATOR-6  HAS-QUALITY  GREEDY  ]  for  use  with  RULE-23 

To  use  RUI  E  23  I  need  to  know  if  [  DICTATOR-6  RULE  AGGRESSOR-COUNTRY-5 
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I  am  trying  to  show  [  DICTATOR-6  RULE  AGGRESSOR-COUNTRY-5  J 
Supply  t  =  true.  ?  =  don’t  know,  I  =  look,  or  a  precedent: 

>  t 

The  evidence  from  RULE-23  indicates!  AGGRESSOR-COUNTRY-5  WANT  [ 

AGGRESSOR  COUNTRY  5  OWN  VICTIM  COUNTRY-5  ]  ] 

To  use  RUI  E  li  I  need  to  know  if  (  AGGRESSOR  COUNTRY  5  HAS-QUALITY 
MISLED  ] 

I  am  trying  to  show  [  AGGRESSOR  COUNTRY  5  HAS  QUALITY  MISLED  ] 

Supply  t  =  true.  ?  =  don’t  know,  I  =  look,  or  a  precedent: 

>  I 

For  [  AGGRESSOR  COUNTRY  5  HAS  QUALITY  MISLED  ] 

I  use  indexes  in  AGGRESSOR  COUNTRY  5  AGGRESSOR-COUNTRY  COUNTRY  THING 

and  I  have  discovered:  RULE- 1 5 

Matching  EXERCISE-WW-7  against  RULE-15 


17.  values  match  with  32.  and  45.  possible. 

Normalized  score  is  53.  r'r 

Match  is  decisive  -  10.  better  than  next  best. 

I  note  that  [  AGGRESSOR  COUNTRY-5  HAS  QUALITY  WEAK  ]  for  use  with 
RULE  15 

1  note  that  [  DICTATOR-6  RULE  AGGRESSOR  COUNTRY-5  ]  for  use  with 
RULE  15 

I  note  that  [  DICTATOR-6  HAS-QUALITY  GREEDY  ]  for  use  with  RULE-15 
The  evidence  from  RLILE-15  indicates!  AGGRESSOR-COIINTR  Y-5  HAS-QUALITY 
MISLED  ] 

The  evidence  from  RULE  19  indicates  (  AGGRESSOR  COUNTRY-5  ATTACK 
VICTIM  COUNTRY  5  J 

Rule  RULE-26  is  derived  from  RULE-19  RULE-15  RULE-23 
and  looks  like  this: 

Rule 

RULE-26 

if 

l  DICTATOR  12  HAS-QUALITY  GREEDY  ] 

[  DICTATOR-12  RULE  AGGRESSOR -COUNTRY-1 1  ] 

I  AGGRESSOR -COUNTRY  !  I  HAS  QUALITY  WEAK  ] 

then 

(  AGGRESSOR  COUNTRY  II  ATTACK  VICTIM-COUNTRY-1 1  ] 

case 

RULE-19  RULE  15  RULE  23 
Should  I  index  it? 

>  y 

Noting  that  [  AGGRESSOR-COUNTRY  ATTACK  VICTIM-COUNTRY  ]  in 
AGGRESSOR  COUNTRY  suggests  RULE-26  for  THEN 

In  EXERC1SE-WW-8  there  are  an  aggressor-country  a  dictator  a  country 
and  a  victim-country.  The  aggressor-country  is  misled.  The  dictator 
is  greedy.  The  dictator  ruled  the  aggressor-country.  Show  that  the 
aggressor-country  in  EXERCISE-WW-8  may  be  defeated. 

I  am  trying  to  show  [  AGGRESSOR-COUNTRY-6  HAS-QUALITY  DEFEATED  ) 


■  V.'l 
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Supply  t  =  true, 1  **  don’t  know,  I  -  look,  or  a  precedent: 
>  \v\v 

Matching  EXERCISE  WW-8  against  \VW 
. 50. 


24.  values  match  with  30.  and  150.  possible. 

Normalized  score  is  80.  % 

Match  is  dec  isive  -  I.  better  than  next  best. 

To  me  \V\V  I  need  to  know  if  [  COUNTRY  5  HAS-QUALITY  LOYAL  ] 

I  am  trying  to  show  [  COUNTRY-5  HAS  QUALITY  LOYAL  ] 

Supply  t  ~  true,  ?  =*  don’t  know,  I  =  look,  or  a  precedent: 

>  t 

•  I  note  that  [  AGGRESSOR  COUNTRY -6  HAS  QUALITY  MISLED  ]  for  use  with  WW 
I  note  that  [  DICTATOR  7  RULE  AGGRESSOR  COUNTRY-6  ]  for  use  with  WW 
I  note  that  [  DICTATOR  7  HAS  QUALITY  GREEDY  ]  for  use  with  WW 
The  evidence  from  WW  indicates  [  AGGRESSOR-COUNTR Y-6  HAS-QUALITY 
DEFEATED  ] 

Rule  RIILE  28  is  derived  from  WW  and  looks  like  this: 

Rule 

RULE  28 
if 

(  DICTATOR  13  HAS  QUALITY  GREEDY  ] 

[  DICTATOR  13  RULE  AGGRESSOR  COUNTRY-12  ] 

(  AGGRESSOR  COUNTRY-12  HAS-QUALITY  MISLED] 

[  COUNTRY  10  HAS  QUALITY  LOYAL  ] 

then 

(  AGGRESSOR-COUNTRY-12  HAS  QUALITY  DEFEATED] 

case 

WW 

Should  I  index  it0 

>  y 

Noting  that  [  AGGRESSOR  COUNTRY  HAS  QUALITY  DEFEATED  )  in 
AGGRESSOR  COUNTRY  suggests  RULE-28  for  THEN 

In  EXERCISE  WW-P  there  are  a  country  an  aggressor-country  and  a 

victim -country.  The  ountry  is  loyal.  The  aggressor-country  attacks 

the  victim  country.  Show  that  the  country  in  EXERC1SE-WW-9  may  attack 

the  aggressor-country. 

1  am  trying  to  show  [  COUNTRY  6  ATTACK  AGGRESSOR-COUNTRY-7  ] 

Supply  t  =  true,  0  «  don’t  know,  I  »  look,  or  a  precedent: 

>  ww 

Matching  WW  against  EXERCISE-WW-9 


18  values  match  with  150.  and  23.  possible. 

Normalized  store  is  78.  rr 

Match  is  decisive  --  5.  better  than  next  best. 

I  note  that  [  COUNTRY -6  HAS-QUALITY  LOYAL  ]  for  use  with  WW 
I  note  that  [  AGGRESSOR  COUNTRY-7  ATTACK  VICTIM-COUNTRY-7  ] 
for  use  with  WW 

The  evidence  from  WW  indicates  [  COUNTRY-6  ATTACK  AGGRESSOR-COUNTRY-7 


Patrick  H.  Winston 


-  53  - 


) 

Rule  RULE-30  is  derived  from  WW  and  looks  like  this: 

Rule 

RULE-30 

if 

[  AGGRESSOR-COUNTRY-13  ATTACK  VICTIM  COUNTRY-12  ] 

[  COUNTRY-1 1  HAS  QUALITY  LOYAL  ] 

then 

[COUNTRY  II  ATTACK  AGGRESSOR-COUNTRY-13) 

case 

WW 

Should  !  index  it? 

>  y 

Noting  that  [  COUNTRY  ATTACK  AGGRESSOR -COUNTRY  ]  in  COUNTRY  suggests 
RULE-30  for  THEN 

In  Cl  there  is  John.  John  is  a  patient  and  a  diabetic.  John’s  blood 
is  some  blood.  The  blood’s  blood-sugar  is  high  because  the  blood’s 
blood-insulin  is  low.  The  blood-insulin  is  low  because  John’s 
pancreas  is  unhealthy.  John  is  a  diabetic  because  John’s  pancreas  is 
unhealthy.  John’s  heart  is  unhealthy  because  the  blood-sugar  is  high. 

John  takes  some  medicine-insulin  because  the  blood-insulin  is  low. 

John  needs  to  take  the  medicine-insulin  because  it  is  bad  that  the 
blood’s  blood-insulin  is  low  and  because  John’s  taking  of  the 
medicine-insulin  prevents  the  blood’s  blood-insulin  being  low. 

In  C2  there  is  Tom  and  some  medicine-insulin.  Tom  is  a  diabetic. 

Tom’s  blood  is  some  blood.  The  blood’s  blood-sugar  is  high.  Th<? 
blood’s  blood-insulin  is  some  blood-insulin.  In  C2  show  that  Tom's 
heart  is  unhealthy. 

I  am  trying  to  show  [  HEART-2  HAS-QUALITY  UNHEALTHY  ] 

Supply  t  -  true.  0  *  don’t  know.  1  -  look,  or  a  precedent: 

>  cl 

Matching  Cl  against  C2 

. . 50. 

. 100. 

.  150. 

.  200. 

.  250. 

46.  values  match  with  151.  and  53.  possible. 

Normalized  score  is  86.  % 

Match  is  decisive  -  2.  better  than  next  best. 

I  note  that  [  BLOOD  SUGAR  2  HAS  QUALITY  HIGH  )  for  use  with  Cl 
The  evidence  from  Cl  indicates  (  HEART  2  HAS  QUALITY  UNHEALTHY  ) 

Rule  RUI  E  3 1  is  derived  from  Cl  and  looks  like  this: 

Rule 

RULE  31 
if 

[  BLOOD  SUGAR  4  HAS  QUALITY  HIGH  ] 
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then 

[  HEART  3  HAS  QUALITY  UNHEALTHY  ] 

ca<.e 

Cl 

Should  I  index  it? 

>  >' 

Noting  that  [  HEART  HAS  QUALITY  UNHEALTHY  ]  in  DIABETIC  suggests 
RULE  31  for  THEN 

In  C 2  verify  that  Toni's  heart  is  unhealthy. 

I  am  trying  to  show  [  HEART-2  HAS  QUALITY  UNHEALTHY  ] 

Supply  t  =  true.  ?  **  don’t  know,  I  -  look,  or  a  precedent: 

>  I 

For  [  HEART-2  HAS  QUALITY  UNHEALTHY  ] 

I  use  indexes  in  TOM  DIABETIC  PATIENT  PERSON 
and  I  have  discovered:  RULE-31 
Matching  C 2  against  RLILE-31 

. 50. 

.  100. 

27.  values  match  with  54.  and  54.  possible. 

Normalized  score  is  50. 

Match  is  decisive  --  6.  better  than  next  best. 

I  note  that  [  BLOOD-SUGAR-2  HAS-QUALITY  HIGH  ]  for  use  with  RULE-31 
The  evidence  from  RULE-31  indicates  [  HEART- 2  HAS-QUALITY  UNHEALTHY  ] 

In  C2  show  that  Tom  takes  the  medicine-insulin. 

I  am  trying  to  show  [  TOM  TAKE  MEDICINE-INSULIN-2  ] 

Supply  t  »  true,  ?  •=  don’t  know,  I  -  look,  or  a  precedent: 

>  c  I 

Should  I  use  the  last  match  between  C2  and  Cl  ? 

>  y 

Beware*  Lise  of  match  required  creating  PANCREAS-2  for  PANCREAS-1 
I  note  that  [  BLOOD-SUGAR-2  HAS  QUALITY  HIGH  ]  for  use  with  Cl 
1  note  that  [  TOM  AKO  DIABETIC  ]  for  use  with  Cl 
All  consequences  of  [  PANCREAS-2  HAS  QUALITY  UNHEALTHY  ) 
are  confirmed. 

The  evidence  from  Cl  indicates  [  TOM  TAKE  MEDICINE-INSULIN-2  ] 

Rule  RULE-32  is  derived  from  Cl  and  looks  like  this: 

Rule 

RULE  32 
if 

[  DIABETIC  2  AKO  DIABETIC  ] 

(  BLOOD  SUGAR  5  HAS  QUALITY  HIGH  ] 

then 

|  DIABETIC  2  TAKE  MEDICINE  INSULIN  3  ] 

case 

Cl 

Should  1  index  it1 
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Noting  that  [  DIABETIC  TAKE  MEDICINE-INSULIN  ]  in  DIABETIC  suggests 
RULE-32  for  THEN 

In  C2  show  that  it  is  bad  that  the  blood-insulin  is  low. 

I  am  trying  to  show  ( [  BLOOD-INSULIN-2  HAS-QUALITY  LOW  ]  HAS-QUALITY 
BAD] 

Supply  t  =  true,  ?  =  don’t  know,  I  =  look,  or  a  precedent: 

>  cl 

Should  I  use  the  last  match  between  C2  and  Cl  ? 

>  y 

I  note  that  [  [  HEART-2  HAS-QUALITY  UNHEALTHY  ]  HAS-QUALITY  BAD  ] 
for  use  with  Cl 

The  evidence  from  Cl  indicates  [  [  BLOOD-INSULIN-2  HAS-QUALITY  LOW  ] 
HAS  QUALITY  BAD  ] 

Rule  RULE-33  is  derived  from  Cl  and  looks  like  this: 

Rule 

RULE  33 
if 

[  t  HEART  4  HAS  QUALITY  UNHEALTHY  ]  HAS-QUALITY  BAD  ] 

then 

[  [  BLOOD  INSULIN-4  HAS  QUALITY  LOW  ]  HAS  QUALITY  BAD  ] 

case 

Cl 

Should  I  index  it? 

>  y 

Noting  that  [  HAS-QUALITY  HAS  QUALITY  BAD  ]  in  DIABETIC  suggests 
RULE-33  for  THEN 

In  C2  show  that  Tom  needs  to  take  the  medicine-insulin. 

I  am  trying  to  show  [  TOM  NEED  [  TOM  TAKE  MEDICINE-INSULIN-2  ]  ] 

Supply  t  -  true,  ?  *»  don’t  know,  I  «=  look,  or  a  precedent: 

>  ci 

Should  I  use  the  last  match  between  C2  and  Cl  ? 

>  >’ 

To  use  Cl  I  need  to  know  if  [  [  TOM  TAKE  MEDICINE-INSULIN-2  ]  PREVENT 
(  BLOOD-INSULIN-2  HAS-QUALITY  LOW  ]  ] 

I  am  trying  to  show  [  [  TOM  TAKE  MEDICINE-INSULIN-2  ]  PREVENT  [ 
BLOOD-INSULIN-2  HAS  QUALITY  LOW  ]  ] 

Supply  t  -=  true,  ?  -  don’t  know,  I  *  look,  or  a  precedent: 

>  t 

I  note  that  [  [  BLOOD-INSULIN-2  HAS-QUALITY  LOW  ]  HAS-QUALITY  BAD  ] 
for  use  with  Cl 

The  evidence  from  CI  indicates  (  TOM  NEED  [  TOM  TAKE 
MEDICINE  INSULIN  2  ]] 

Rule  RULE-34  is  derived  from  Cl  and  looks  like  this: 

Rule 

RULE-34 

if 


Patrick  H.  Winston 


-  56  - 


Experiments 


[  [  BLOOD-INSULIN-5  HAS-QUALITY  LOW  ]  HAS-QUALITY  BAD  ] 

[  [  DIABETIC  4  TAKE  MEDICINE-INSULIN-4  ]  PREVENT  [ 

BLOOD  INSULIN-5  HAS-QUALITY  LOW  ]  ] 
then 

[  DIABETIC  4  NEED  [  DIABETIC-4  TAKE  MEDICINE-INSULIN-4  ]  ] 

case 

Cl 

Should  I  index  it? 

>  >’ 

Noting  that  [  DIABETIC  NEED  TAKE  ]  in  DIABETIC  suggests  RULE-34  for 
THEN 

In  C3  there  are  Dick  and  some  medicine-sugar.  Dick  is  a  diabetic. 

Dick's  blood  is  some  blood.  The  blood’s  blood-sugar  is  low  because 
the  blood's  blood-insulin  is  high.  Dick’s  brain  is  unconscious 
because  the  blood-sugar  is  low.  It  is  bad  that  Dick's  brain  is 
unconscious.  In  C3  Show  that  Dick  needs  to  take  the  medicine-sugar. 

I  am  trying  to  show  [  DICK  NEED  [  DICK  TAKE  MEDICINE-SUG  AR-I  ]  ] 

Supply  t  =  true.  ?  =  don't  know.  I  »  look,  or  a  precedent: 

>  cl 

Matching  Cl  against  C3 

. 50. 

. 100. 

.  150. 

.  200. 

.  250. 

52.  values  match  with  151.  and  102.  possible. 

Normalized  score  is  50.  % 

.  Match  is  indecisive.  Top  two  matches  are  equally  good. 

To  use  Cl  I  need  to  know  if  [  [  DICK  TAKE  MEDICINE-SUGAR-1  ]  PREVENT  [ 
BLOOD  SUGAR  3  HAS  QUALITY  LOW  ]  ] 

I  am  trying  to  show  [  [  DICK  TAKE  MEDICINE-SUGAR-I  ]  PREVENT  ( 

BLOoiD  SUGAR-3  HAS  QUALITY  LOW  ] ) 

Supply  t  =  true,  ?  =  don’t  know,  I  -  look,  or  a  precedent: 

>  t 

I  note  that  [  [  BLOOD  SUC.AR-3  HAS-QUALITY  LOW  ]  HAS-QUALITY  BAD  ] 
for  use  with  Cl 

The  evidence  from  Cl  indicates  [  DICK  NEED  [  DICK  TAKE 
MEDICINE  SUGAR-1  ]  ] 

Rule  RLILE-35  is  derived  from  Cl  and  looks  like  this; 

Rule 

RULE  35 
if 

[  [  BLOOD-SUGAR -6  HAS-QUALITY  LOW  J  HAS-QUALITY  BAD  ] 

( [  DIABETIC  5  TAKE  MEDICINE  SUGAR  2  ]  PREVENT  [  BLOOD-SUGAR-6 
HAS  QUALITY  LOW  ]  ] 
then 

[  DIABETIC-S  NEED  [  DIABETIC-5  TAKE  MEDICINE-SUGAR-2  ]  ] 


case 
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Cl 

Should  I  index  it? 

>  y 

Noting  that  (  DIABETIC  NEED  TAKE  ]  in  DIABETIC  suggests  RULE-35  for 
THEN 

In  C4  there  is  Jack.  Jack  is  a  patient.  Jack's  blood  is  some  blood. 

The  blood’s  blood-salt  is  low.  Jack’s  taking  of  some  medicine-salt 
prevents  the  blood-salt  to  be  low  because  the  medicine-salt  is  some 
medicine  and  because  the  blood-salt  is  a  blood-part. 

In  Cl  show  that  John’s  taking  of  the  medicine-insulin  prevents  the 
blood-insulin  to  be  low. 

I  am  trying  to  show  [  [  JOHN*TAKE  MEDICINE-INSULIN-I  ]  PREVENT  [ 
BLOOD-INSULIN- 1  HAS  QUALITY  LOW  ]  ] 

Supply  t  »  true,  ?  -  don’t  know,  I  =  look,  or  a  precedent: 

>  c4 

Matching  Cl  against  C 4 

. 50. 

. 100. 


30.  values  match  with  152.  and  54.  possible. 

Normalized  score  is  55.  CJ- 

Match  is  decisive  —  2.  better  than  next  best. 

I  note  that  [  BLOOD-INSULIN- 1  AKO  BLOOD-PART  ]  for  use  with  C4 
I  note  that  [  MEDICINE-INSULIN-I  AKO  MEDICINE  )  for  use  with  C4 
The  evidence  from  C4  indicates  [  [  JOHN  TAKE  MEDICINE-INSULIN-I  ] 
PREVENT  [  BLOOD-INSULIN- 1  HAS-QUALITY  LOW  ]  j 
Rule  RLILE-36  is  derived  from  C4  and  looks  like  this: 

Rule 

^ULE-36 

[  MEDICINE-INSULIN  5  AKQ  MEDICINE  ] 

[  BLOOD-INSULIN-6  AKO  BLOOD  PART  ] 

then 

[  [  PATIENT-1  TAKE  MEDICINE-INSULIN-5  ]  PREVENT  ( 

BLOOD  INSULIN-6  HAS  QUALITY  LOW  ]  ] 
case 

C4 

Should  I  index  it? 

>  y 

Noting  that  [  TAKE  PREVENT  HAS-QUALITY  ]  in  PATIENT  suggests  RULE-36 
for  THEN 


